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ABSTRACT 


A  radar  is  basically  a  measuring  instrument  for  extracting  informa¬ 
tion  from  a  received  signal  voltage.  The  amount  of  information  that  can  be 
extracted  is  ultimately  limited  by  the  noise  background.  The  concept  of 
measurable  information  has  been  quantitatively  developed  in  the  literature 
and  provides  a  means  by  which  substantial  insight  may  be  acquired  into  the 
generalized  nature  of  optimum  radar  processing. 

The  presented  work  exhibits  an  interpretation  of  radar  information 
consistent  with  intuitive  views  of  radar  processing  as  well  as  with  formal 
definitions  of  information  theory.  The  approach  has  led  to  the  following 
specific  results. 

(a)  A  unified  description  of  the  mechanism  by  which  both  detection 
capability  and  parameter  estimation  are  optimized  simultaneously.  A  two- 
dimensional  matched  filter  is  described  in  which  the  ideal  radar  processing 
is  seen  to  consist  of  a  two-dimensional  "involution"  in  which  the  signal1  s 
input  energy  area  in  the  time -frequency  plane  is  compressed  into  an  interior 
area. 

(b)  The  two-dimensional  compression  of  Item  (a)  can  be  increased, 
in  both  the  time  and  frequency  domains  by  a  factor  of  J  p  ,  where  p  is  two 
times  the  signal-to-noise  energy  ratio,  by  employing  an  envelope  detector 
having  the  characteristic  of  Iq(x),  the  modified  Bessel  function. 

(c)  The  definition  of  a  "distributional"  type  of  physical  entropy 

that  is  associated  with  parameter  information.  For  a  given  a  priori  sur¬ 
veillance  window  within  which  we  search  for  a  target,  it  is  shown  that  there 
is  a  minimum  threshold  energy  required  to  make  a  meaningful  measure¬ 
ment.  Furthermore,  the  total  amount  of  range  and  Doppler  parameter  in¬ 
formation  obtained  is  bounded  such  that  the  information  is  always  less  than 
the  threshold  entropy  ,  where  V  is  the  equivalent  noise  temperature 

of  the  radar.  It  is  also  shown  that  the  minimum  signal-to-noise  energy  ratio 
required  to  detect  the  presence  of  a  signal  immersed  in  one  noise  mode 
(independent  sample)  is  equal  to  a  defined  "absolute"  information  entropy 

of  the  noise  sample,  which  is  calculated  to  be  unity. 

(d)  An  equivalence  between  the  amplitude  detection  threshold  com¬ 
monly  employed  in  radar  and  the  energy  threshold  employed  in  physics  for 
setting  the  "reliability"  of  a  measurement. 


(e)  The  development  of  a  new  detection  procedure  h  *-'d  upon  a 

defined  •detection  information"  and  the  employment  of  the  '‘'earson 

procedure  in  the  threshold-crossing  rate  domain  rather  than  in  tne  standard 
amplitude  domain. 

(f)  A  new  representation  of  band- limited  or  time -limited  Gaussian 
noise  based  upon  the  identification  of  independent  noise  "modes"  in  the  time- 
frequency  plane,  with  each  mode  having  an  energy  described  by  the  Boltzmann 
factor  of  statistical  mechanics  and  occupying  an  area  of  one  logon  in  the  time- 
frequency  plane. 

(g)  An  explicit  formula  for  parameter  information  in  terms  of  a 
multiple -target  echo  ambiguity  function. 

(h)  By  defining  a  distributional  type  of  information  in  a  gas  problem 
involving  thermodynamic  entropy,  a  formula  is  derived  which  is  directly 
analogous  to  Shannon1  s  formula  for  the  information  communicated  through 

a  noisy  channel. 
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1.  INTRODUCTION 


1.  1  Summary 

A  radar  is  basically  a  measuring  instrument  for  extracting  information  from  a 
received  signal  voltage.  The  amount  of  information  that  can  be  extracted  about  such 
signal  parameters  as  range  delay  and  Doppler  frequency  is  ultimately  limited  by  the 
noise  background.  Radar  theory  has  shown  that  both  detection  capability  and  parameter- 
estimation  accuracy  are  explicitly  dependent  upon  the  ratio  of  total  received  signal 
energy  to  noise  power  spectral  density  {for  white  Gaussian  stationary  noise).  Further¬ 
more,  both  detection  capability  and  parameter  estimation  are  optimized,  within  the 
class  of  linear  filters,  by  the  so-called  "matched  filter"  . 

The  concept  of  measurable  information  has  been  quantitatively  developed  in  the 
literature  and  provides  a  means  by  which  substantial  insight  may  be  acquired  concern¬ 
ing  the  generalized  nature  of  optimum  radar  processing.  It  is  apparent  that  a  radar 
obtains  information  only  upon  reception  of  a  quantity  of  energy.  Moreover,  the  amount 
of  information  acquired  depends  upon  the  degree  of  concentration  {in  time  and  frequency) 
of  the  input  energy  as  it  is  introduced.  The  degree  of  concentration,  in  turn,  is  meas¬ 
urable  in  terms  of  the  increase  in  physical  entropy  experienced  by  the  radar  instrument. 
We  find  that  a  greater  amount  of  input  information  implies  a  smaller  increase  in  entropy. 
In  fact,  a  negative  form  of  entropy  (negentropy)  can  be  defined  which  implies  the  avail¬ 
ability  of  thermal  work  due  to  mixing  or  diffusion.  This  negentropy  is  received  when¬ 
ever  information  is  obtained.  If  a  non-dissipative  process  is  assumed  in  which  input 
energy  is  conserved,  it  is  concluded  that  availability  of  thermal  work  is  created  when¬ 
ever  information  is  received.  We  have  therefore  arrived  at  a  principle  of  a  cybernetic 
nature,  namely,  that  information  (of  the  type  considered)  is  interpretable  as  a  physical 
entity  rather  than  only  an  arbitrary  "measure"  .  (Section  3.  3)  , 

If  the  input  energy  is  not  well  concentrated  in  time  or  frequency  (or  both)  as  it 
enters  the  radar,  maximum  information  may  still  be  extracted  by  using  a  matched 
filter.  The  role  of  the  matched  filter  is  interpretable  as  the  reverse  of  diffusion.  That 
is,  it  compresses  the  area  occupied  by  the  input  signal  energy  in  the  time -frequency 
plane  (with  signal  time -bandwidth  products  greater  than  unity).  For  example,  suppose 
we  are  using  a  linear- FM  (chirp)  signal  with  a  relatively  wide  bandwidth  of  B  cps.  The 
matched  filter  has  a  comparable  bandwidth.  At  the  matched  filter  output,  the  signal 
energy  is  compressed  into  a  time  interval  of  1/B  seconds  which  is  also  the  duration  of 


*  Section  references  in  parentheses  refer  to  sections  of  this  dissertation  where  the 
subject  is  primarily  developed. 
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an  output  independent  noise  sample.  Let  us  assume  that  the  input  pulse  has  a  duration 
of  P  seconds  and  the  a  priori  uncertainty  in  our  knowledge  of  range  delay  extends  over 
a  range  window  of  T  seconds.  At  the  input  to  the  matched  filter,  the  received  range 
information  is  measurable  as  log2  T/P  bits,  whereas  it  is  log2  TB  bits  at  the  matched 
filter  output.  We  now  have 

log2  TB  >  log2  T/P  ,  (1.1) 

since  PB  >  1  for  signals  with  time -bandwidth  products  greater  than  unity.  Therefore, 
the  matched  filter  may  be  said  to  have  increased  the  measured  information  (and  negen- 
tropy).  (Section  3.  2). 

Physical  entropy  is  the  ratio  of  u.n  energy  increment  to  absolute  temperature 
and,  in  radar,  it  is  shown  that  this  is  synonymous  with  signal-to-noise  energy  ratio. 
Thus,  the  analysis  of  optimum  radar  processing  in  terms  of  information  theory  leads 
to  significant  relations  among  various  quantities  such  as  information  entropy,  physical 
entropy  and  signal-to-noise  energy  ratio.  Furthermore,  it  becomes  evident  that  radar 
detection  capability  and  (range-Doppler)  parameter  estimation  are  necessarily  opti¬ 
mized  by  the  same  mechanism  which  involves  a  compression  of  the  signal' s  energy 
area  in  the  time -frequency  plane.  (Section  3.2). 

The  presented  work  exhibits  an  interpretation  of  radar  information  consistent 
with  intuitive  views  of  radar  processing  as  well  as  with  the  formal  definitions  of  infor¬ 
mation  theory.  Moreover,  the  additional  insight  provided  by  the  approach  has  lead  to 
the  following  specific  results: 

(a)  A  unified  description  of  the  mechanism  by  which  both  detection  capability 
and  parameter  estimation  are  optimized  simultaneously.  A  two-dimensional  matched- 
filter  concept  is  described  in  which  the  ideal  radar  processing  is  seen  to  consist  of  a 
two-dimensional  "involution"  in  which  the  signal' s  input  energy  area  in  the  time-fre¬ 
quency  plane  is  compressed  into  an  interior  area.  The  two-dimensional  matched  filter 
is  found  to  be  a  time-frequency  gate  which  overlaps  the  signal' s  input  energy  area  in 
the  time -frequency  plane.  (Section  3.  2). 

(b)  The  two-dimensional  compression  of  Item  (a)  can  be  increased,  in  both 
the  time  and  frequency  domains  by  a  factor  ofVp~»  where 

2E  _  2  x  signal  energy  7. 

P  “  Nq  -  noise  power  spectral  density  ’  *  * 

by  employing  an  envelope  detector  having  the  characteristic  of  the  modified  Bessel 
function  (of  first  kind  and  zero  order)  IQ(x).  (Section  3.  2). 

(c)  The  definition  of  a  "distributional"  type  of  physical  entropy  that  is 
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associated  with  parameter  information.  For  a  given  a  priori  surveillance  window 
within  which  we  search  for  a  traget,  it  is  shown  that  there  is  a  minimum  threshold 
energy  E^,  required  to  make  a  meaningful  measurement.  Furthermore,  the  total  amount 
of  range  and  Doppler  parameter  information  obtained  is  bounded  such  that  the  information 
is  always  less  than  the  threshold  entropy  where  ?  is  the  equivalent  noise  tem¬ 

perature  of  the  radar.  It  is  also  shown  that  the  minimum  signal-'.o -noise  energy  ratio 
required  to  detect  the  presence  of  a  signal  immersed  in  one  noise  mode  (independent 
sample)  is  equal  to  a  defined  "absolute”  information  entropy  of  the  noise  sample, 
which  is  calculated  to  be  unity.  (Sections  3.1,  3.2,  3.3). 

(d)  An  equivalence  between  the  amplitude  detection  threshold  commonly 
employed  in  radar  and  the  energy  threshold  employed  in  physics  for  setting  the 
"reliability”  of  a  measurement.  (Section  3. 1). 

(e)  The  development  of  a  new  detection  procedure  based  upon  threshold¬ 
crossing  rate.  In  this  method,  the  amplitude  threshold  is  set  to  maximize  "detection 
information"  .  Using  this  optimum  amplitude  threshold,  a  specific  false-alarm  thresh- 
hold-crossing  rate  is  thereby  established  and  accepted  as  normal.  A  data-rate  thres¬ 
hold  is  then  set  for  a  selected  probability  of  a  "false-alarm  type  of  mistake"  (or  Type-1 
error  in  statistical  estimation  theory).  If  the  threshold-crossing  rate  should  exceed 
the  established  data-rate  threshold,  a  target  is  judged  to  be  present.  Thus  the  statis¬ 
tical  Neyman-Pearson  approach  is  applied  to  the  (threshold-crossing)  rate  variate 
rather  than  to  the  voltage  amplitude.  In  one  example  using  realistic  radar  parameters, 
it  is  shown  that  the  detection-information  procedure  increased  the  detection  probability 
from  40%  (using  the  more  conventional  Neyman-Pearson  procedure  on  amplitude)  to 
89%  after  5  seconds  of  processing  at  a  fixed  overall  faise-alarm  probability  of  1%  and 

a  signal-to -noise  ratio  of  6  db«  Furthermore,  in  the  detection-information  method, 
there  are  no  "false  alarms*  in  the  usual  sense  which  then  obligate  the  radar  to  take 
further  measures  to  confirm  or  reject  the  hypothesis  that  a  target  is  present.  That  is, 
amplitude -threshold  crossings  are  expected  to  occur  on  an  occasional  basis  in  the 
detection-information  procedure.  It  is  the  increase  in  this  threshold -crossing  rate 
which  is  important.  The  possibility  of  a  "false  alarm  type  of  mistake"  stems  from  the 
uncertainty  in  determining  the  rate  due  to  a  finite  observation  time.  (Sections  4. 1, 

4.  2,  4.  3  and  Chapter  6). 

(f)  A  new  representation  of  band-limited  or  time -limited  Gaussian  noise  is 
utilized  which  is  analogous  to  a  two-dimensional  Karhunen-Loeve  expansion.  The 
representation  is  based  upon  the  identification  of  independent  noise  "modes"  in  the 
time -frequency  plane,  with  each  mode  having  an  energy  described  by  the  Boltzmann 
factor  of  statistical  mechanics  and  occupying  an  area  of  one  logon  in  the  time-frequency 
plane.  This  noise  representation  is  particularly  useful  in  the  information-analysis  of 
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radar  but  should  also  be  found  helpful  in  other  noise  problems. 

r 

(g)  An  explicit  formula  for  parameter  information  is  derived  in  terms  of  a 
multiple -target  echo  ambiguity  function.  The  formula  yields  results  which  are  con¬ 
sistent  with  intuitive  notions  and  formal  definitions  of  information.  Consideration  o£ 
these  results  shows  that  contour  areas  may  be  defined  similar  to  "ambiguity  areas"  . 
An  explicit  interdependence  coefficient  between  range  and  Doppler  information  is  de¬ 
fined  which  is  unity  for  linear-FM  modulation  and  zero  with  no  frequency  modulation 
(pulsed-CW).  The  parameter-information  formula  may  also  be  used  for  waveform 
evaluation.  For  example,  the  decrease  in  total  received  information  may  be  computed 
for  two  proximate  targets  of  various  amplitudes  as  their  spacing  is  decreased  to  zero, 
(Chapter  5). 

(h)  By  defining  a  distributional  type  of  information  in  a  gas  problem  involving 
thermodynamic  entropy,  a  formula  is  derived  which  is  directly  analogous  to  Shannon' s 
formula  for  the  information  communicated  through  a  noisy  channel.  (Section  3.  3). 


1.  2  Historical  Background 


The  early  radars  transmitted  simple  pulses  of  energy  at  a  constant  frequency. 
The  i-f  bandwidth  (in  cps)  was  empirically  determined^"  to  be  optimum  when  it  was 
chosen  approximately  equal  to  the  reciprocal  to  the  pulse  width  (in  seconds).  At  that 
time,  the  expression  "signal -to -noise  ratio"  generally  referred  to  the  ratio  of  rms 
echo  signal  voltage  to  rms  noise  voltage,  i,  e. , 

A  A 

Signal-to-noise  voltage  ratio  =  SNVR  =  ,  (1.  3) 

ffN  4  N  B 

o 

where 

A _ =  rms  voltage  of  pulsed  sinusoid 

rms  3 

cr^  =  rms  noise  voltage 

NQ  =  white  noise  power  spectral  density 

B  -  i-f  bandwidth. 

The  signal-to-noise  power  ratio  is  then 


SNPR 


rms 

NqB 


(1.4) 


If  we  multiply  the  numerator  and  denominator  of  Eq.  (1, 4)  by  the  signal  pulse  duration 
P,  and  use  the  optimum  i-f-bandwidth  condition 


B  = 


(1.5) 


* 


then  Eq.  (1.4)  becomes 


SNPR  = 


A2  P 
rms  F 


ctm  p 


rms  P 


in  which 

E  =  signal-pulse  energy 

Nq=  noise  power  spectral  density  =  k(7  »  where  k  is  Boltzmann*  s 
constant  and  ?  is  equivalent  noise  temperature. 

Therefore,  with  the  pulsed-CW  signal,  application  of  the  optimum-bandwidth  condition 
of  Eq.  (1.  5)  leads  to  the  result  that  the  SNPR  is  equal  to  a  ratio  of  signal  and  noise 
energy  quantities: 

SNER  =  -2L  .  (1.7) 

iNo 

The  SNER  is  a  more  general  parameter  than  the  SNPR  or  SNVR  since  it  involves  only 
signal  and  noise  (energy)  properties,  but  no  explicit  radar  characteristics.  This  re¬ 
sult  is  a  consequence  of  using  the  optimization  condition  of  Eq.  (1.  5). 

The  generalized  importance  of  the  SNER  became  more  evident  a.e  the  theory 

and  practice  of  radar  advanced  beyond  the  use  of  simple  sinusoidal  pulses.  Radar 

theory  advanced  along  two  distinct  paths,  respectively  referred  to  as  detection  and 

parameter  estimation,  and  the  SNER  attained  prominence  in  both  areas.  In  a  paper 

2 

concerned  primarily  with  detection,  North  showed  in  1943  that,  with  an  arbitrary 
signal  waveshape,  the  linear  filter  which  maximized  the  ratio  of  peak  output  signal 
power  to  mean-square  output  noise  possessed  a  frequency  response  function  which  was 
the  complex  conjugate  of  the  input  signal  spectrum  (Fourier  transform).  Moreover, 
under  these  optimum-detection  conditions,  the  ratio  of  output  peak  power  to  mean- 
square  noise  was  found  to  be  E/Nq  for  the  bandpass  case.  Thus,  for  a  general  signal 
waveshape,  the  detection  capability  depended  ultimately  upon  the  SNER,  whereas  the 
SNPR  and  SNVR  merely  appeared  as  special  cases  appropriate  mainly  for  the  pulsed- 
CW  signal.  Numerous  papers  dealing  solely  with  the  detection  problem  appeared,  and 

various  approaches  were  developed  such  as  the  application  of  the  Neyman-Pearson 

3-5  6 

statistical  estimation  procedure  to  output  voltage  amplitude,  the  Ideal  Observer  , 

the  Bayes  Criterion2,  the  Sequential  Observer2’  ,  Inverse  Probability^-*8, 

19  20 

zero-crossing  criteria  and  non-parametric  methods  . 

In  the  area  of  parameter  estimation,  general  waveshapes  were  also  treated. 

15-17 

In  work  by  Woodward  and  Davies  using  the  approach  of  ** inverse  probability*  , 
it  was  shown  that  range  delay  could  be  measured  with  an  ultimate  accuracy  of 


*s*cn*u  ^ 


a 

T 


(1.8) 


where 


1 


standard  deviation  of  range-delay  measurement 

a  normalized  signal  bandwidth 
2E/Nq  . 


_ ,  18  21 

Further  results  *  ,  of  a  more  generalized  nature,  involving  the  joint  estimation  of 

range  delay  t  and  Doppler  shift  ,  showed  that  the  Doppler  frequency  could  be  deter¬ 
mined  to  an  accuracy  of 


where, 


(1.9) 


a4> 

47 


standard  deviation  of  Doppler  frequency  measurement 
a  normalized  signal  duration 


P  =  2E/Nq. 

As  in  the  radar  detection  problem,  the  analytical  results  dealing  with  parameter  esti¬ 
mation  again  revealed  the  preeminence  of  the  SNER  in  governing  the  ultimate  limita¬ 
tions  of  radar  measurements. 


A  synthesis  of  the  two  areas  of  detection  and  parameter  estimation  tended  to 
develop  with  the  recognition  that  the  same  filter  which  optimized  detection  capability 
also  implemented  the  required  correlation  operation  by  which  the  optimum  parameter- 
estimation  process  was  accomplished.  This  is  the  so-called  North  filter,  or  matched 
filter. 

The  concepts  of  information  theory  were  originally  developed  in  a  context  some- 

22 

what  remote  from  the  radar  application.  In  1924,  Nyquist  considered  limitations  on 

the  rate  of  telegraph  transmission  and  utilized  a  logarithmic  measure  of  information, 

23 

This  logarithmic  measure  was  later  employed  by  Hartley  ,  and  then  developed  into 

24 

an  elaborate  and  rigorous  framework,  called  information  theory,  by  Shannon  ,  The 
term  (information)  entropy  was  employed  in  connection  with  the  concept  of  information 
evidently  because  of  the  similarity  in  form  between  the  logarithmic  measure  of  a 
number  of  alternative  states  to  be  communicated  and  the  physical  entropy  of  statistical 
mechanics  which  has  been  related  to  the  logarithm  of  the  number  of  states  (or  com¬ 
plexions)  of  a  physical  system. 


7 


17 

Some  results  of  information  theory  were  related  to  radar  applications  ,  but 

without  substantial  expansion  of  the  approach  by  later  investigators.  However,  signi- 

25 

ficant  relations  were  observed  by  Brillouin  between  the  entropy  measure  used  in 
information  theory  and  the  physical  entropy  of  thermodynamics  and  physics.  These 
were  brought  out  by  examples  in  various  types  of  physical  measurements. 

As  a  result  of  the  historical  development  reviewed  above,  the  fields  of  radar 
and  information  theory  have  progressed  to  a  point  where  it  has  become  possible  to 
take  a  more  unified  and  quantitative  view  of  generalized  optimum  radar  processing, 
and  to  relate  the  amount  of  information  received  by  a  radar  to  the  amount  of  input  phy¬ 
sical  energy  required  to  obtain  it.  This  approach  has  been  pursued  in  the  present 
dissertation.  In  addition,  interpretations  of  the  role  of  the  matched  filter  as  a  device 
for  optimum  information  extraction,  and  various  other  results,  have  been  derived  as 
described  in  Section  1. 1. 


8 


2,  TlilE -BANDWIDTH-LIMITED  GAUSSIAN  NOISE 


2. 1  Conventional  Methods  of  Analysis 

When  stationary  noise  is  treated,  standard  analytical  techniques  involve  the  use 

26 

of  an  autocorrelation  function 


1  T 

R  (t)  =  lim  f  x(t  +  t  ):«(t)  dt 

T— *00  -T 


(2.1) 


where  x(t)  is  a  real  noise  waveform.  The  power  spectral  density  is  then  given  by  the 
Fourier  transform  relation 


Sx(f)  =  I  RJr)  e  “j2lTfT  dl 
-00 

27 


(2.2) 


by  the  Wiener -Khintchine  theorem, ' 


If  the  noise  is  not  stationary,  a  useful  approach  is  that  employed  by  Bello. 
Letting 

x(t)  =  x(t)  e  j2n  V 


28 


(2.  3) 


represent  a  complex  narrow -band  noise  time  function,  where  x(t)  is  the  complex  modu¬ 
lation  and  £  is  the  carrier  frequency,  then  a  time -varying  complex  autocorrelation 
function  is  defined  in  the  time  domain  as 

(2.4) 


r(t,  s)  =  x*(t)  x(s) 


where  t  and  s  are  two  time  instants,  the  overhead  bar  denotes  an  ensemble  average, 
and  the  *  represents  the  complex  conjugate  operation.  If  X(f)  is  the  Fourier  transform 
of  x(t),  then  an  analogous  frequency-varying  autocorrelation  function  may  be  defined  in 
the  frequency  domain  by 


R(f,|)  =  X*(f)  X(£) 


(2.  5) 


Using 


__  oo 

X(f)  =  J  x(t)  e 


-j2irft 


dt 


-oo 


in  Eq.  (2,  5),  we  have 


oo  oo 


R(f,£)  =  J  f  x*(t)  x(s)  e 
-00  -00 


-j2n  (si  -  ft) 


dt  ds 


oo  oo  -J2tt  (si  -  ft) 

=  f  f  r(t,  s)  e  dt  ds 

-oo  -oo 


(2.  6) 


(2.7) 
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Eq  (2.  7)  expresses  a  fundamental  duality  between  the  time  and  frequency  domains, 
with  the  two  domains  being  related  by  a  double  Fourier  transform.  It  should  be  noted 
that  the  analysis  proceeds  either  in  the  time  domain  or  the  frequency  domain.  How¬ 
ever,  in  the  following  material  we  shall  work  in  both  domains  simultaneously  by  deal¬ 
ing  with  areas  of  the  time -frequency  plane.  This  method  will  be  found  particularly 
useful  for  the  information-theory  approach  to  radar  analysis, 

2,  2  Two-Dimensional  Representation 

2,  2, 1  Noise  Occupancy  in  the  Time -Frequency  Plane 

We  consider  first  the  case  of  white  Gaussian  noise  which  is  bandpass- 
limited  to  a  bandwidth  of  B  cps.  At  the  output  of  the  band-limiting  filter,  the  noise  will 
be  observed  for  a  time  duration  of  T  seconds.  By  the  sampling  theorem  for  bandpass- 
limited  noise,  there  are  TB  independent  noise  samples  involved,  with  each  sample 
having  two  "degrees  of  freedom*  such  as  amplitude  and  phase  (or  the  real  and  imaginary 
parts  of  the  complex  voltage).  It  is  important  to  observe  that  we  are  not  physically 
limiting  (truncating)  in  both  time  and  frequency,  which  cannot  be  rigorously  defended. 
(That  is,  the  Fourier  transform  of  a  truncated  time  function  extends  through  an  infinite 
range  of  frequencies. )  We  are,  in  fact,  truncating  only  in  frequency  and  then  observ¬ 
ing  for  a  specific  time.  This  type  of  noise  will  be  described  as  boundary-limited  in 
the  frequency  domain  and  window -limited  in  the  time  domain.  The  situation  is  portrayed 
in'  Fig.  2.1(a).  Each  rectangular  sub-area  represents  an  independent  noise  sample 

with  two  degrees  of  freedom  covering  an  area  of  unity  in  the  time -frequency  plane. 

29 

Such  a  unit  of  area  will  be  called  a  "logon"  ,  following  Gabor. 

The  dual  of  the  preceding  case  is  shown  in  Fig.  2. 1(b),  where  the  noise  has  been 
time-gated  to  a  duration  of  P  seconds.  The  frequency  axis  then  represents  the  inde¬ 
pendent  noise  samples  as  observed  by  a  spectrum  analyzer.  The  presence  of  independ¬ 
ent  noise  samples  in  the  frequency  domain  after  time-gating  may  be  less  familiar  than 
independent  samples  in  the  time  domain  after  bandwidth-limiting.  An  experimental 
display  of  this  phenomenon  will  be  found  in  reference  30,  Fig.  6.  As  in  the  previous 
dual  case,  each  independent  noise  sample  again  occupies  an  area  of  one  logon  with  the 
frequency  separation  between  samples  being  l/P  cps. 

2.  2.  2  Application  of  the  Boltzmann  Factor 

The  concepts  of  the  preceding  section  can  be  conveniently  formalized  by 
an  interpretation  involving  the  Boltzmann  factor  of  statistical  mechanics.  We  consider 
a  physical  system  at  a  temperature.  V  which  possesses  n  degrees  of  freedom,  where 
each  degree  of  freedom  may  occupy  any  one  of  M  possible  energy  levels  with  equal 
likelihood  in  the  absence  of  any  other  constraints.  In  a  classical  problem  of  physics, 
the  question  is  asked,  "What  is  the  most  probable  energy  state  of  the  system  subject 


aaw»: 


i 


-i' 


v 


1 


to  the  two  constraints  that:  (a)  the  total  number  of  degrees  of  freedom  is  a  constant, 
and  (b)  the  total  system  energy  is  a  constant?"  To  solve  this  problem,  let  FQ  be 
the  overall  number  of  ways  that  n  degrees  of  freedom  can  occupy  M  energy  levels. 
Now  suppose  a  situation  in  which  n^  degrees  of  freedom  are  in  level  Ep  degrees 
of  freedom  are  in  level  E£, . . . ,  and  n^  degrees  of  freedom  are  in  level  Ej^  .  By 
combinatorial  analysis,  the  number  of  ways  in  which  this  can  occur  is 


P  _  ni _ 

1  n!1  "a2,***nMI 


The  relative  frequency  for  this  condition  is 

p  _  F1  _  nl 

"  *o  FoV  n2l“*nM! 


where  P  may  be  taken  as  the  probability  of  the  state  represented  by  F,.  We  wish  *o 
maximize  F  subject  to  the  constraints 

n  =  /  n.  =  number  of  degrees  of  freedom  =  a  constant  (2,10) 

i=  1  1 

M 

Ec  =  y  n.E.  =  total  system  energy  =  a  constant  ,  (2.11) 

i=  1  1  1 


(2.11) 
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Using  principles  of  variational  calculus  '  ,  it  has  been  found  that  the  most  probable 

energy  state  of  the  system  is  such  that  the  energy  of  any  degree  of  freedom  has  a 
probability  distribution  E 

i 

r .  (2. 12) 


P(Ej) 


where 


k  =  Boltzmann*  s  constant. 


As  the  energy  levels  are  taken  closer  together,  the  probability  distribution  approaches 


the  continuous  form 


p(E)  a  e 


The  exponential  e  is  known  as  the  Boltzmann  factor. 

If  we  assume  that  p(E)  may  be  normalized  directly,  then 

E 

CO  00  -  n 

f  p(E)  dE  =  f  7  e  dE  =  1 
J0  J0 


(2.13) 


(2.14) 
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where  y  is  the  normalizing  constant.  Direct  integration  yields 

7  =  -L- 
k2 

and  thus  E 

P(E)  =  i 


(2. 15) 


(2. 16) 


It  may  be' noted,  however,  that  such  an  exponential  probability  density  function  is  the 
Chi-square  distribution  with  two  degrees  of  freedom.  This  form  would  apply  for  a 
physical  system  composed  of  many  harmonic  oscillators.  Each  harmonic  oscillator 
possesses  two  degrees  of  freedom  and  the  energy  variate  E  in  Eq.  (2. 16)  would  be 
applicable  for  each  harmonic  oscillator  as  a  unit.  We  shall  call  such  a  tin  it  (with  two 
degrees  of  freedom)  a  mode. 


Using  Eq.  (2.16),  it  is  found  that  the  average  energy  of  a  mode  is 


E  =  f  E  p(E)  dE  =  k-2 
J0 


The  standard  deviation  is 


(2. 17) 


ffE  =^/0  (E-E)Zp(E) 


=  Tk7 


(2. 18) 


which  is  the  same  as  the  mean  value. 


To  illustrate  the  applicability  of  these  results  to  the  noi6e  problem,  we  refer 
back  to  Fig.  2.1(a).  There  are  TB  noise  modes  comprising  the  noise  waveform.  If 
the  average  energy  of  each  mode  is  k  3  ,  then  the  total  average  energy  of  the  noise 


waveform  is 


Eg  =  TBk? 

Since  this  average  energy  is  spread  over  a  time  T,  the  average  power  is 
P  =  -fjr-  =  k  7  B 


(2.19) 


(2.  20) 


which  is  immediately  recognized  as  the  available  noise  power  (o^  )  of  white  noise  that 
has  been  bandlimited  to  B.  Finally,  the  power  spectral  density  is  given  by 


(2.  21) 


V 
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Once  allowing  the  validity  of  the  above  approach,  it  is  seen  to  be  a  simple  derivation 
for  the  power  spectral  density  of  white  noise  as  compared,  for  example,  with  the 
method  of  reference  33,  A  block  diagram  for  observing  the  type  of  random  noise  pro¬ 
cess  being  considered  is  shown  in  Fig.  2,  2,  which  is  self  explanatory.  The  system 
essentially  observes  a  manifestation  of  the  so-called  "available*  noise  power. 

We  can  obtain  a  further  result  of  significance  by  considering  the  voltage  waveform 
just  prior  to  envelope  detection.  This  waveform  is  sketched  in  Fig,  2.  3.  It  is  possible 
to  identify  the  individual  modes  as  "packets"  of  energy  of  time  duration  At#  . 

The  energy  of  such  a  mode  would  be  given  by 


E  = 

2 


(2.  22) 


where  R  is  the  peak  envelope  voltage  of  the  mode.  The  probability  density  function  for 
R  is  therefore  determined  from  the  Jacobian  of  the  transformation  between  E  and  R  as 


P(R)  =  p(E)  -jg-  = 


R 

TFfE" 


k.?B 


(2.  23) 


which  is  the  Rayleigh  distribution,  as  would  be  expected.  The  Rayleigh  distribution, 

of  course,  characterizes  the  amplitude  of  the  vector  sum  of  two  orthogonal  Gaussian- 

distributed  component  vectors.  These  component  vectors  represent  two  degrees  of 

freedom  and  may  be  thought  of  as  the  real  and  imaginary  parts  of  the  complex  voltage 
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envelope,  as  used  by  Rice. 

2.  2.  3  Karhunen-Lo^ve  Expansion  in  Two  Dimensions 

The  type  of  noise  representation  developed  in  the  preceding  section  in¬ 
volves  a  characterization  in  both  the  time  and  frequency  domains  simultaneously, 
rather  that  the  more  conventional  approach  of  working  in  one  domain  or  the  other  with 
connecting  Fourier -transform  transitions.  The  two-dimensional  approach  may  be 
formalized  further  by  using  a  Karhunen-Lo^ve  type  of  expansion  in  two  variables.  We 
may,  for  example,  define  a  "state  function"  4i(t« £)  by  the  expansion 


T£ 

t.  f)  =  ]j  a-i  (t,  f) 


(2.  24) 


where  the  case  in  Fig.  2. 1(a)  is  being  treated.  In  general,  the  coefficients  a.  may  be 
complex.  Each  of  the  eigenfunctions  i(j^(t,  f)  will  represent  a  noise  mode  and  the  follow¬ 
ing  orthonormality  conditions  will  obtain 


/  /  *  (t»  *)  iMt,  f)  dt  df  =  6^ 

-CO  -OO  *  “ 


(2.25) 
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Fig.  2.  2  Block  Diagram  for  Observing  Bandpass-Limited  Noise  Consisting  of  TB  Modes 


Bandpass -Limited  White  Gaussian  Noise  Prior 
Envelope  Detection 


where  6-.  is  the  Kronecker  delta  function.  Since  each  noise  mode  is  constrained  to 
ij 

occupy  an  area  of  one  logon  in  the  time -frequency  plane,  the  Heisenberg  uncertainty 
(or  indeterminacy)  principle  applies.  There  is  a  Fourier -transform  constraint  between 
the  time  and  frequency  axes  for  each  mode.  To  illustrate  this,  we  may  consider  the 
white  noise  to  be  composed  of  impulses  (as  is  ordinarily  done)  as  it  enters  the  filter 
of  bandwidth  B  cps.  The  output  of  the  filter  therefore  consists  of  a  multitude  of  impulse 
responses,  many  of  which  a”e  too  close  together  to  be  resolvable  due  to  the  finite  filter 
bandwidth.  A  resolvable  impulse  response  of  the  filter,  however,  and  the  filter*  s  fre¬ 
quency  response  function  (of  width  B  in  this  case)  are  Fourier  transform  pairs,  and 
together  they  encompass  one  noise  mode. 

Letting  the  center  frequency  of  the  filter  be  fQ  and  choosing  equally  spaced  central 
time  instants  L  for  each  mode,  as  shown  in  Fig.  2. 1(a),  with  i  =  1,  2, ... ,  TB,  then  the 
Fourier  constraint  may  be  applied  as 


**(t.,f)  =  f°  4*i(t, fQ)  e  "•>2TrAdt 
-00 

4<iM0)=  f°  (V  £)e  j2,rftdf 

-03 

If  we  consider  the  energy  of  the  process  to  be 

TB 

°o  oo  *  _ 

ES  '  f  J  +‘(t.Q«Kt,f)  dtdf  =  Yj  I  ail ' 

-0°  -00  i=  1 


(2.  26a) 


(2.  26b) 


E.  =  a. 

i  1  i1 


(2.  27) 


(2.  28) 


may  be  interpreted  as  the  energy  of  the  ith  mode  having  a  probability  density  function 
given  by  the  directly-normalized  Boltzmann  factor  and  having  an  average  value  of 
=  k^  for  all  i.  The  absolute  values  |a.  |  are  therefore  Rayleigh-distributed. 

—  •  -We  may -fxm’Sts*uot-«aa-e«ample  of  consistent  functions  satisfying  .the  etat;e.d.£ODdi-. _ 
dons  from  the  situation  of  Fig.  2. 1(a).  Let 


^(t, f)  =  ^(t,f0)  +.(t.,  f) 

which  is  a  product  of  two  functions.  For  a  rectangular  passband,  suppose 

f-fo  -j2ir(f-f0)T. 

4*i  ^ )  =  K  rect  (  — g— )  e  »  i=l,  2,  .1.,  TB  , 
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where  Woodward*  s  notation  has  been  employed,  namely. 


(2.  29) 


(2.  30) 
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3.  RADAR  SIGNAL  PROCESSING36,  37 

J 

3.1  Pulsed-CW  Radar 

3. 1. 1  Measurement  of  Range  Only 

In  order  to  develop  some  fundamental  relations  involving  radar  information, 
we  shall  first  consider  a  simple  pulsed-CW  radar  for  the  measurement  of  range  only. 

It  is  assumed  that  the  target  is  known  to  be  approximately  stationary  in  space,  A 
block  diagram  of  such  a  system  is  shown  in  Fig.  3, 1,  where  the  optimum  i-f  band¬ 
width  B  is  used.  I.  e. , 

B  =  -p  cps  ,  (3.1) 

for  a  pulse  width  of  P  seconds. 

On  the  CRO  display,  we  observe  noise  modes  having  a  time -width  of  P  seconds, 
due  to  the  i-f  bandwidth  restriction  of  B  cps,  and  a  signal  echo  response  also  having 
a  width  in  the  order  of  P  seconds.  (Ideally,  for  a  rectangular  transmitted  signal 
envelope  and  a  rectangular  i-f  filter  pass  band,  the  signal  response  at  the  output  of 
the  i-f  filter  is  triangular  with  a  base  width  of  2P  seconds. )  The  property  that  the 
signal  response  has  the  same  duration  as  a  noise  mode  is  characteristic  of  all  matched- 
filter  radars  and  it  will  be  shown  later  that  this  condition  is  optimum  in  terms  of  the 
radar’ s  efficiency  in  acquiring  information. 

Consideration  of  the  radar  output,  as  displayed  on  the  CRO  in  Fig.  3.1,  indicates 
the  need  for  a  threshold  test  to  establish  a  measurement  "reliability"  .  Clearly  we 
cannot  accept  all  identifiable  peaks  as  signal  responses  since  most  of  them  are  due  to 
noise.  However,  if  a  sufficiently  high  amplitude  threshold  level  R^,  is  set,  as  illustra¬ 
ted  in  Fig.  3, 1,  then  reasonable  assurance  can  be  obtained  that  a  threshold  crossing 
is  indeed  due  to  the  presence  of  signal  and  not  due  to  noise  alone.  Higher  threshold 
settings  imply  greater  measuremett  reliability  but  decreased  sensitivity  to  low-level 
signals. 

A  reasonable  way  to  evaluate  the  efficacy  of  the  threshold  level  setting  is  to  com¬ 
pute  an  overall  falrse  alarm  probability  given  by 

PFA  =  1  '  -  P'fa»TB  •  (3-2> 

\ 

where 

TB  =  total  number  of  independent  opportunities  for  a  threshold¬ 
crossing  due  to  noise  alone,  within  the  range -delay  surveil¬ 
lance  window  T 
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Block  Diagram  of  Basic  Pulsed-CW  Radar  for  the 
Measurement  of  Range  Only 


P^,^  =  probability  that  a  single  noise  mode  will  cross  the 
amplitude  threshold 

Pp^  =  probability  that  one  or  more  threshold  crossings  will 
occur  due  to  noise  z.lone. 


TB  PpA  <<1 


as  is  usually  the  case,  we  have 


pfa"tbpS?a 


by  use  of  a  truncated  binomial  expansion.  Since  the  measurement  reliability  increases 
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with  decreasing  values  of  Pp^,  it  is  reasonable  to  define  a  reliability  factor  r,  given 
by 


P  =  — 
FA  r 


(3.5) 


Now,  from  Eq.  (2. 16), 

E  ET 

co  .  "Tf 

P'*A-  4  •  <3’ 

where 

E^,  =  modal  energy  threshold  corresponding  to  amplitude 
threshold  . 

Substituting  Eqs.  (3.  5)  and  (3.  6)  into  Eq.  (3.  4)  and  taking  the  natural  logarithm  of 
both  sides  of  the  resulting  equation,  it  is  found  that 


Ey-  =  In  r  TB  .  (3. 7) 

Certainly  a  measurement  with  r  <  2  would  be  sufficiently  unreliable  to  be  meaningless, 
since  this  would  imply  an  overall  false  alarm  probability  of  greater  than  50%.  Thus, 
for  any  meaningful  physical  measurement,  we  must  have 


>  In  TB 


(3.8) 


Now  consider  the  amount  of  information  obtained  by  the  measurement.  Prior  to 
any  observation,  the  target  range  delay  was  presumed  to  be  somewhere  within  the  a 
priori  surveillance  window  of  T  seconds.  After  the  measurement,  the  signal  may  be 
localized  to  a  range-delay  interval  of  l/B  =  P  seconds,  assuming  that  the  threshold 
has  been  crossed.  From  the  standard  approach  of  information  theory,  the  uncertainty 
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yr- 


has  been  reduced  by  a  factor  of  T/P  =  TB  so  the  acquired  information  is 
1^  =  log£  TB  bits  , 


(3.9) 


where  the  superscript  (2)  indicates  that  a  logarithmic  base  of  2  has  been  employed. 
The  information  may  also  be  expressed  in  other  units.  For  example,  it  may  be  said 
that  the  information  obtained  is 
(e) 

I'  '  =  In  TB  natural  units  (called  nits  or  nats)  (3.10) 


or 


It  =  k  In  TB  thermodynamic  units 


(3.11) 


where  k  is  Boltzmann*  s  constant.  The  latter  form  is  derived  by  analogy  with  the  recult 
of  statistical  mechanics  that  thermodynamic  entropy  is  equal  to  k  times  the  natural  log¬ 
arithm  of  the  number  of  system  “complexions"  in  the  most  probable  state  of  the  system. 


Tt  is  now  possible  to  reach  the  conclusion  that,  for  any  meaningful  measurement 
of  range  delay  in  the  problem  posed,  we  have 


or 


>  I(e> 


(3. 12) 

(3.13) 


That  is,  the  signal-to -noise  energy  ratio  E/k  7  always  exceeds  the  information  obtained, 
where  the  latter  is  expressed  in  natural  units,  or  equivalently,  the  input  entropy  quan¬ 
tity  E ly  always  exceeds  the  information  expressed  in  thermodynamic  units.  In  any 
measurement,  we  would  like  to  maximize  1^.  as  much  as  possible,  but  it  can  be  no 
greater  than  E^,/.7  .  The  inequalities  of  Eqs.  (3.12)  and  (3.13)  establish  an  equivalence 
between  the  SNER  employed  in  radar  terminology  with  the  concept  of  physical  entropy. 

They  also  specify  a  lower  bound  on  the  input  SNER  required  to  make  a  measurement 

(e) 

which  can  provide  a  specific  amount  of  information  I'  However,  they  do  not  expli¬ 
citly  specify  what  information  advantage  or  disadvantage  is  incurred  if  a  high  reliabil¬ 
ity  factor  r  is  employed,  or  if  the  input  SNER  exceeds  the  threshold  value  by  a  signifi¬ 
cant  amount.  These  questions  will  be  more  clearly  formulated  in  the  later  discussions, 

3. 1.  2  Measurement  of  Doppler  Only 

We  shall  here  consider  a  pulsed-CW  radar  for  the  measurement  of 

Doppler  shift  only.  The  basic  block  diagram  for  the  system  is  shown  in  Fig.  3.  2. 

The  spectrum  analyzer  may  be  thought  of  as  a  bank  of  contiguous  filters  of  bandwidth 

30  38 

B  =  l/P  cps,  or  a  Coherent  Memory  Filter.  ’  The  surveillance  window  is  now  in 
the  Doppler  domain  and  is  designated  as  W  cps.  The  number  of  independent  noise 


TRANSMITTED  PULSE 
WIDTH  =  P  SECONDS 
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modes  within  the  surveillance  window  is  PW  and  therefore  the  threshold  energy  must 
be  such  that 


>  In  PW 


(3. 14) 


in  order  for  the  reliability  factor  r  to  be  at  least  a  value  of  2 .  Since  the  information  irs 

,  (3. 15) 


I(e)  =  In  PW 


we  again  have  the  result  stated  in  Eq.  (3.12). 


3.2 


Radars  with  General  Transmitted  Waveforms 

39  40 

3.2.1  Chirp  Radars  for  the  Measurement  of  Range  Only  ' 


We  consider  first  a  special  waveform  of  major  importance,  namely, 
linear-FM  modulation,  as  illustrated  in  Fig.  3.  3(a)  by  an  instantaneous  frequency-vs- 
time  plot  along  side  of  the  signal  spectrum.  As  with  the  pulsed-CW  range -only 
measurement,  the  target  is  assumed  stationary  in  this  example.  The  matched  filter 
has  a  frequency  response  function  which  is  the  complex  conjugate  of  the  signal  spec¬ 
trum  shown  in  Fig.  3.  3(a).  Therefore,  the  output  noise  modes  have  a  duration  of  l/B 


compressed  to  a  time  width  of  l/B  seconds.  The  number  of  independent  noise  modes 
in  the  surveillance  window  is  TB  and  therefore  the  threshold  energy  must  be  such  that 


>  In  TB  ,  (3. 16) 

and  Eq.  (3. 12)  again  holds.  (The  block  diagram  is  shown  in  Fig.  3,  3(b). 

3.  2.  2.  Simultaneous  Measurement  of  Range  and  Doppler  Shift 

3.  3,  2. 1  General  Two-Dimensional  Compression  (Maximum-Likelihood 
Receiver) 

3.  2.  2. 1.1  Linear  Detection 

In  this  more  general  case,  the  theoretical  radar  model  is  as  shown  in 

17 

Fig.  3.4.  Following  the  method  of  inverse  probability  for  the  joint  estimation  of 
range  delay  and  Doppler  shift  (single  target  assumed),  we  wish  to  determine  the  values 
of  t  and  4>  which  maximize  the  a  posteriori  (conditional)  probability  p(f,<{>A  )  •  By  the 

}jC  ' 

Bayes  equality,  we  have 

P(f»<j>/ 4 )  =  pU/t,*)  .  (3.17) 


W 


Complex  signal  notation  is  used,  as  reviewed  in  Appendix  A. 


(a)  Instantaneous  Frequency-Vs,  -Time  Plot  and  Signal  Spectrum 


(b)  Basic  Block  Diagram 


Fig.  3,  3  Chirp- Type  Radar  for  the  Measurement  of  Range  Only 


TRANSMITTER 


26 


where 


P(t»*I>A)  =  conditional  a  posteriori  density  function  for  t  and  <j>, 

given  the  received  noisy  signal  £(t)  =  inverse  probability 

p(T»<j>)  =  a  priori  probability  {before  the  measurement) 


p(4/T,<t>)  =  likelihood  function 

p(t,)  =  a  normalizing  function  such  that 


oo 


f  P(r,4>)/t)  dT  d4>  = 

-00 


1. 


If  p(t,<)>)  is  uniform,  it  is  seen  that  the  method  of  inverse  probability  leads  to  a  maxi¬ 
mum  likelihood  estimate  since  maximization  of  p(r,<J)/^)  is  then  equivalent  to  maximi¬ 
zation  of  p(£,/t,4>).  Following  this  customary  assumption  of  a  uniform  a  priori  distri¬ 
bution,  it  follows  that 

pfeA.4»)  =  P(v(t)  =  ?,  (t)  -TiT  (j>(t))  *  (3. 18) 

where 


c(t> 


a  given  fixed  waveform  observed 


v  r^dorh'hoisd^roc^ss ,  bandlihiTteci' to'^o* ftii  “Iront-eiiu”' 

bandwidth  of  W*  cps 

■n  ,(t)  =  A£(t-x)  e^2n^>t  =  echo  signal  voltage  (3.19) 

T  f  4* 

in  which  A  is  a  real  constant  amplitude  factor,  and  r  and  <j> 
are  both  assumed  constant  . 


If  the  receiver  front-end  is  gated  open  for  a  time  duration  T1 , 


then 


18 


This  is  a  powerful,  though  inconsistent,  classical  radar  assumption  that  has  led  to 
many  useful  results.  However,  in  the  case  of  very  large  time -bandwidth  products, 
the  assumption  is  inappropriate.  41  in  that  case,  a  more  exact  representation  is 

^  jZTrf  (t- r(t)) 

T|  (t)  =  A  I(t  -  t  (t))=  A  |(t  -  T  (t))e 

where  §(t)  is  the  complex  modulation  and  fQ  is  the  carrier  frequency.  If,  for  example 

T  (fc)  =  TQ  +  T  t, 

then  .  j2irf  t  -j2irf  rt  -j2trf  t 

q(t)  =  A|(t(l-T)  -tq)  e  0  e  °  e  °  °  , 

in  which  the  Doppler  shift  may  be  recognized  as  <j>  *-fQT  =  ~2f  —  where  r  is  radial 
velocity  and  c  is  the  speed  of  light.  Also,  for  the  very  high  finear  velocities  char¬ 
acteristic  of  space  probes,  satellites  and  astronomical  bodies,  relativistic  effects 
may  not  be  negligible. 


t 

'  & 


?(Z/ T,«j>)  = 


(2jrk?W'  ) 


"zih  /  lv<tH< 

*  -00 


T?Re  «dt 


(3.  20) 


where  the  latter  result  of  proportionality  is  derived  using  the  identity, 


|v(t)|2=  U(t) -^T  +<t)|2=  |c,(t)|2 -2Re  4(t)T!*  >4>{t)  +  UT  j<t>(t)|2  .  (3.21) 


Defining 


r'  ( T ,  <j>)  =  4(t)n*  >  ^(t)  dt  =  a  f°  ;(t)  §*(t  -  T )  e“j2ir  <*,t  dt 

=  A  [  I(t)f  (t-T)  e-*»*  dt]  ej2irf°T 


(3.22) 


where  f,(t)  and  |(t)  are  the'-complex  modulations,  then 

v  v 

,  “IF?  Ir *  (■*■»<(>) | eos  (2irf  r  +  arg  T' (r,<J>)  ) 

p(^/t  ,<)>)a  e 


(3.23) 


The  exponent  reveals  high-frequency  fluctuations  with  respect  to  the  t  variable. 
These  are  r-f  phase  effects  which  may  be  averaged  out  over  one  r-f  cycle  by  defining 
an  area-preserving  smoothed  version  of  p(^/ t  .«(>)  given  by 

t  +  i-  f 

?.  o 

P  (T  ,  <j>)  *  f  p(t,/ T  ,  ({>)  dT 

Z  J  1 


u  rt  T-2F 

T+  zr 

of  °  e 
J  1 
T'  a 


|r'  (t  , 4>)  j cos(2tt fQT  +arg  r'  (t,4>)) 


^-[TMr^Lj 


(3.  24) 


where  I  (x)  is  the  modified  Bessel  function  of  first  kind  and  zero  order, 
o 

A' 

Since  the  function  IQ(x)  is  a  monotonic  function  of  x,  the  most  probable  estimates 
of  t  and  <}>  may  be  obtained  by  determining  those  values  which  maximize 
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'Cr. 

■£ 


r 

s* 

I) 

s»v 

& 


& 


28 

|r*  {r,<j>)|  =Aj  f  4(t)  |:'(t-r)  e'j2ir<^t  dt|  (3.25a) 

-oo 

=  A|  f  i(£)t*(£-«|>)  ej2rrTf  dfj  ,  (3.25b) 

-oo  ' 

A  A 

where  £,  (f)  and  £(f)  are  the  Fourier  transfoi.ns  of  £,(t)  and  |(f),  respectively.  This 
complex  correlation  process  constitutes  a  linear  operation  on  the  received  noisy  echo 
^(t),  followed  by  a  linear  envelope  detection.  The  surface  |r  •  (t  .  4>)  |  will  be  called 
the  correlation  surface  and  its  typical  appear?  >ce  is  as  illustrated  in  Fig.  3.  5.  The 
maximum -likelihood  estimates  are  t  and  $  .  The  range  and  Doppler  resolutions  are 
the  widths  of  the  correlation  surface  in  the  t  and  <()  directions,  which  are  in  the  order 
of  1/B  seconds  and  1/ P  cps,  respectively,  where  B  cps  is  the  signal  bandwidth  and  P 
seconds  is  the  signal  duration.  These  resolutions  are  readily  deduced  from  Eqs. 

(3.25a)  and  (3,25b).  That  is,  Eq.  (3.25a)  indicates  that  the  correlation  operation  on 
t, (t)  consists  of  a  multiplication  by  a  function  £*(t-T),  which  is  time -truncated  to  P 
seconds,  followed  by  a  Fourier  transform  to  thet|>  domain.  The  surface  width  in  the 
4>  domain  is  therefore  approximately  1/ P  s.  In  the  other  hand,  Eq.  (3.  25b)  shows 
that  the  correlation  operation  can  be  viewed  as  a  multiplication  in  the  frequency  domain 
followed  by  an  inverse  Fourier  transform  to  the  t  domain.  The  frequency  width  of 
|(f)  which  is  also  the  frequency  width  of  the  matched  filter)  is  equal  to  B  cps,  and 
therefore  the  width  of  the  correlation  surface  in  the  r  domain  is  in  the  order  of  l/B 
seconds. 

The  two-dimensional  matched-filter  process  is  summarized  with  reference  to 
Fig.  3.  6.  It  is  assumed  that  the  "front  endB  receiver  characteristic  passes  a  wide 
band  of  frequencies  W*  for  a  time  duration  T* ,  the  latter  being  taken  up  to  a  maximum 
of  the  pulse  repetition  period  (or  unambiguous  range  interval).  The  echo  signal’s  energy 
arrives  in  the  rectangle  of  area  PB.  The  two-dimensional  matched  filter  character¬ 
istic  is  shown  to  the  right  and  it  basically  constitute?  a  time -frequency  gate  which 
overlaps  the  signal*  s  energy  area.  The  effect  of  tl  j  matched  filter  is  to  "involute** 
the  signal*  s  input  energy  area  PB  by  compressing  it  into  an  essentially  interior  rec- 
tangle  of  area  1/ PB.  If  PB  =  1,  there  is  no  compression.  The  rectangle  of  area  TW 
represents  a  surveillance  area  within  which  we  look  for  targets.  This  surveillance 
area  should  be  no  larger  than  necessary  because  the  number  of  independent  noise  modes 


In  the  special  ambiguous  case  of  high  interdependence  between  t  and  information, 
as  with  a  linear-FM  modulation,  the  compressed  area  is  elongated  as  shown  by  the 
dotted  ellipse. 
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increases  with  the  surveillance  area  and  compels  a  higher  amplitude -threshold  setting 
for  a  given  overall  false-alarm  probability,  which  implies,  of  course,  a  lower  detec¬ 
tion  probability  for  a  given  signal-to-noise  ratio. 

3.  2.  2. 1.  2  Nonlinear  Detection 

The  two-dimensional  compression  can  be  increased  b^  •  ig  a  nonlinear 
envelope  detector  having  the  characteristic  of  IQ(x),  the  modified  Bessel  function.  In 
particular,  we  generate  a  voltage 


mi » <)>)  =  I 


(3.  26) 


which  is  proportional  to  the  exact  smoothed  a  posteriori  probability  density  function, 
as  seen  from  Eq.  (3.  24),  It  is  known  that  the  standard  deviation  of  the  a  posteriori 
density  function  is^’ 


0  -  . . — - 

VtT 


in  the  f  domain  and 


(3.  27) 


V77 


in  the  4>  domain,  where 
2E 

?  =  w 


2  x  received  signal  energy 
noise  power  spectral  density 


(3.28) 


(3.  29) 


7  = 


(2w)2/°°  f2!^)!2  df 
_ -oo _ 

/Q°li(f)i2  df 


2 

=  (normalized  signal  bandwidth)  (3. 


(2*)2/  t2 1 £{t)  | 2  dt 
_ -00 

f°  lf(t)|2dt 

_/Y\ 


=  (normalized  signal  duration)' 


(3.  31) 


The  standard  deviations  expressed  by  Eqs.  (3.  27)  and  (3,  28)  may  therefore  be  imme¬ 
diately  used  as  an  approximate  measure  of  the  resolution  capabilities  inherent  in  the 
Bessel-functioi,  detector  of  Eq.  (3.  26).  In  terms  of  a  practical  example,  and  a  more 
standard  resolution  definition,  it  is  observed  that  the  3-db  width  of  a  Gaussian  distri¬ 
bution  (from  which  a  and  cr  are  derived  under  high  SNER  conditions)  is  about  1.  6 

T  <p 


i 
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times  the  standard  deviation.  Thus,  the  3-db  resolutions  become 


$: 

(3.  32) 

>; 

JTp 

* 

V7T 

(3.  33) 

in  general,  for  p  »  1.  Furthermore,  if  the  signal  is  truncated  in  a  rectangular  (chirp) 
characteristic,  say- 


then 

VT=  —  r 

vr 

and  the  resolutions  are 

0.9 


-p-)  and  |4(f)|=  rect  (— ^2.) 

f 

(3.  34) 

1. 81  P  andlT?"  =  -L  B  =  1.  81  B 

• 

(3.  35) 

At  a 


A<|>  a 


bVp" 
0.9 
p VF 


(3.  36) 
(3.  37) 


where 


Eq.  (3.  26)  may  be  written  in  a  more  convenient  form  as 

*.<!>)  =  IQ  (p|p(x ,,<{>) | ) 

I  p(t  ,  4*)  I  =  -jj*-  I  r*  (t  ,  q>)  | 


(3.  38) 


(3.  39) 


The  peak  value  of  |r(r,<j>)|  is  approximately  unity  under  conditions  of  high  SNER 
since  then  (neglecting  noise) 


where 


IW  =  An  |(t  -  T  )  e 


r  =  true  value  of  range  delay 
v  ° 

<j>o  =  true  value  of  Doppler  shift 
A  =  true  amplitude  factor, 


(3.40) 


and  therefore,  from  Eq,  (3.  25a), 
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Ir'tvVl  =  lr,<T’4>>l 


00 


=  A  f  k(t  -t  )|  dt  =  2E 

max  o  J  ltx  o'1 

-oo 


(3.41) 


Using  Eq,  (3.  38),  the  Bessel  function  envelope  detector  is  seen  to  operate  as 
43 

shown  in  Fig,  3,7.  The  improvement  in  resolution  resulting  frdm  such  a  detector 
characteristic  is  illustrated  in  Section  6.  2. 1,  It  may  be  noted  that  the  Bessel-function' 
detector  does  not  alter  the  detection  probability,  although  low-level  response  regions 
(such  as  sidelobes)  are  suppressed  for  the  low-noise  case.  The  detection  and  false- 
alarm  probabilities  may  be  established  in  the  linear -envelope  domain  and  these  prob¬ 
abilities  are  merely  transformed,  along  with  the  amplitude -detection  threshold,  by 
the  nonlinear  detection  characteristic. 

3.  2.  2.  2  Doppler -Channel  Implementation 

Prior  to  envelope  detection,  it  is  necessary  to  implement  the  correla¬ 
tion  surface  |  F'  (r,<}>)|,  which  can  be  accomplished  with  linear  systems.  Two  alterna- 
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tive  approaches  to  this  implementation  are  to  use:  *  (a)  Doppler  channels,  or 

(b)  range  channels.  In  this  section,  we  shall  deal  with  the  Doppler -channel  viewpoint 

in  which  <{>  in  Eq.  (3.  25a)  is  quantized  as  <j>^.  Now, 

oo  *  -j2ir(j)  t 

Re(  4(D  g  "(t-r)  e 
-oo 

oo 

(3.42) 


oo  *  -jcjr<j>.t 

Re  IMt.+j)  =  A  f  Re[g(D  g'"(t-T)  e  lJ 


dt 


-j2ir«|>.t 

=  A  J  Re^g(t)  e  1  J  Re  g(t  -  x)  dt 


The  latter  form  is  readily  seen  to  be  equal  to  the  previous  form  by  expanding  the  pro¬ 
duct  of  the  real  (cosine)  parts  in  terms  of  the  cosine  of  the  difference-arguments  and 
the  cosine  of  the  sum-arguments.  The  integration  of  the  term  involving  the  cosine  of 
the  sum-arguments  is  zero  since  that  term  contains  fluctuations  at  r-f  frequencies. 

The  latter  form  in  Eq.  (3.42)  can  be  implemented  by  frequency- shifting  the 
received  signal  g(t)  downward  by  (j>.  cps  (or  passing  the  received  signal  through  a 
filter  shifted  upward  by  <}>j  cps  from  the  zero-Doppler  filter),  and  then  applying  the 
signal  to  a  matched  filter  with  impulse  response 

h(t)  =  Reg(P-t)  ,  (3.43) 

where  P  is  the  signal  duration.  By  the  convolution  integral,  the  filter  output  is 

oo  oo  -j2ir<j>.tl 

1 


00 

y(t,  4>t)  =  f  x(t> )  h(t  - 1*  )dt»  =  J  Re  T  4  (t*  )t 
-00  -  00  L 

=  Re  I"  (t  -  P,  <j>.) 


J  Re  |(P-t+t»  )dt» 


(3.  44) 
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The  real-time  axis  at  the  filter  output  is  therefore  the  r  axis,  and  |  T*  (t,c|>)|  is  the 
output  signal  envelope  (see  Appendix  A). 

Each  value  of  represents  a  separate  Doppler  channel  and  the  Doppler -channel 
output  S’gnal  envelope  traces  out  a  cross  section  of  the  correlation  surface  at  <j>  =  <j> .  ,  ■- 
In  order  to  obtain  complete  coverage  within  a  surveillance  window  of  area  TW  in  the 
t  -  <j>  plane,  a  number  of  contiguous  Doppler  channels  are  required.  They  should  be 
spaced  by  approximately  A<(>  =  -p-  cps,  which  is  the  linear  Doppler  resolution  of  the 
system.  Division  of  the  surveillance  area  into  Doppler  channels  is  depicted  in  Fig. 
3.8(a). 

At  the  output  of  each  Doppler  channel,  the  signal  is  compressed  into  the  time- 
width  of  one  noise  mode,  by  reasoning  similar  to  that  employed  in  Section  3.  2. 1. 
Therefore,  Eqs.  (3.12)  and  (3.13)  hold  in  each  channel.  The  information  in  each  chan¬ 
nel  is 

IT(e)  =  In  TB  ,  (3. 45) 

where 

T  =  range -delay  surveillance  window 
B  =  signal  bandwidth, 

and,  in  order  to  obtain  this  information,  it  is  necessary  that 


E  .  T(e) 


3.  2,  2.  3  Range -Channel  Implementation 


(3.  46) 


In  the  range-channel  viewpoint,  range  delay  is  quantized  by  producing  the 


complex  signal 


\{t,Ti)  =  A£(t)  %  (t-T.) 


(3.47) 


the  real  part  of  which  is  the  physical  voltage.  Tne  signal  \(t,  t  can  be  generated  by 
heterodyning  the  received  signal  £(t)  by  a  delayed  replica  of  the  transmitted  signal 
£(t  -r  ,t  and  passing  only  the  difference -frequency  signal.  Then  a  spectrum  analysis  of 
Re  \(t,  t yields  (see  properties  in  Appendix  A) 


z(v<t>)  =  |  V  [Re  X(t,r.)]  |  =  l-  |  gr [\(t,  r i)  ]  | 

i 

=  J  |r*  (Ti,^)i  ;  *  >  0 


(3.48) 


where  ? denotes  the  Fourier-transform  operation  and  4>  is  the  frequency  argument  in 
the  transformed  domain. 
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(a)  Doppler -Channel  Implementation 
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(b'  Range-Channel  Implementation 


Fig.  3.  8  Division  of  Surveillance  Area  into  Doppler  Channels 

or  Range  Channels 


V 


3  < 

Each  value  of  rj  represents  a  separate  range  channel  and  the  spectrum  analysis 
at  the  range-channel  output  traces  out  a  cross  section  of  the  correlation  surface  at 
T  =  i  .  In  order  to  obtain  complete  coverage  within  a  surveillance  window  of  area 
TW  in  the  x  -  <j)  plane,  a  number  of  contiguous  range  channels  must  be  used.  They 
should  be  separated  by  approximately  At  =  -g-  seconds,  which  is  the  linear  range-delay 
resolution  of  the  radar.  Division  of  the  surveillance  area  into  range  channels  is  de¬ 
picted  in  Fig.  3.  8{a). 

At  the  output  of  each  range  channel,  the  spectrum  analysis  has  compressed  the 
frequency  width  of  the  signal  response  into  the  width  of  one  noise  mode,  by  reasoning 
similar  to  that  employed  in  Section  3. 1.  2.  Eqs,  (3. 12)  and  (3. 13)  again  obtain  for  each 
range  channel.  The  information  in  each  channel  is 

l[e)  =  In  PW  ,  (3. 49) 

9 

where 

W  =  Doppler  surveillance  window 

P  =  signal  duration, 

and,  in  order  to  obtain  this  information,  it  is  necessary  that 

&  »  l(*e)  •  <3-50> 

3.  2.  2. 4  Overall  Two-Dimensional  Information 

The  overall  two-dimensional  processing  may  be  viewed  in  terms  of  a 
set  of  independent  radar  channels  with  the  established  separation  between  channels 
(linear  system  resolution)  insuring  that  a  signal  response  occurs  only  in  a  single  channel. 
(If  the  signal  response  were  to  substantially  spill  over  into  other  channels,  which  tends 
to  occur  with  high  x  -  <j>  interdependence  due  to  elongated  ambiguity  areas,  the  channel 
separat  n  should  be  increased,)  In  the  linear  system,  the  total  range-Doppler  infor¬ 
mation  received  (for  a  single  target)  is 


i<e> 

x,4> 


=  in  =  In  TWPB 


l/PB 


=  In  TB  +  In  PW  =  I +  I(®] 
x  <p 


(3.  51) 
(3.  52) 


regardless  of  whether  range  or  Doppler  channels  are  employed.  The  range  and  Doppler 
informations  are  therefore  seen  to  be  additive  and  the  total  information  can  be  calcu¬ 
lated  from  the  (logarithm  of  the)  ratio  of  the  surveillance  area  to  the  compressed 
energy  area,  or  simply  by  adding  the  intra-channel  information  to  the  information 
implied  by  the  localization  of  the  signal  response  to  a  particular  channel.  Using  the 


I 


A 


_v  -v.j  v.w<g«c» 


J» 


Doppler -channel  implementation  as  an  illustration,  there  are  TB  noise  modes  within 
the  range-delay  surveillance  window  of  T  seconds  in  each  channel  and  PW  Doppler 
channels  are  required  to  cover  the  Doppler  surveillance  window  of  W  cps.  There  are 
therefore  TBPW  independent  opportunities  for  a  false  alarm,  so  the  information  of 
Eq.  (3.  5  1)  is  only  obtained  for 


or 


TT 

E 


>  In  TBPW 

(e) 


k  V  >  !t,  <}> 


(3.53) 


(3.54) 


In  the  nonlinear  system,  the  additional  compression  requires  that  the  overall 
t,  <j>  information  be  written  as 


=  In  p  TBPW 

T,  (j>  r 


(3.  55a) 


=  lnVT  TB  +  lnVp"PW  =  (N)IT(e)+  (N)I  (e)  .  (3.55b) 


4> 

If  the  reliability  factor  r  is  again  introduced,  the  inequality  in  Eq.  (3.  53)  is  written 
as 

E, 


TZT 


=  In  r  TBPW 


(3.56) 


in  accordance  with  the  previous  development  connected  with  Eqs.  (3.  7)  and  (3.  8).  We 
may  write  Eq.  (3.  55a)  as 


(N)j  (e)  _  lnp+inTBpW 

T, 


and  Eq.  (3.  56)  as 
ET 

W 


=  In  r  +  In  TBPW 


(3.57) 


(3.58) 


Eliminating  the  term  In  TBPW  between  Eqs.  (3.  57)  and  (3.  58),  we  have 

Z*  =  <N'i  <•>  +  - 

Tf  t,4>  p 

Subtracting  Eq.  (3.  59)  from  the  identity 

_  E  E 

where 


~*r 


k? 


=  p' 


(3.59) 


(3.  60) 


E  =  true  input  energy, 
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we  obtain 


E  -  Er 


k.7 


E 

~W 


(NJl  (e) 

t,  $ 


|-  In 


(3.61) 


In  order  to  accept  the  presence  of  signal  as  such,  we  have  the  detection  criterion 


E  -  Et>  0 


,  <3.62) 


and  therefore,  for  detection, 


E  (N>T  <6>  >  In  r 

TOT  '  it.  *  >  ln  p 


(3.63) 


or 


-  < 


E  (N)t  (e) 


p  >  r  e 


w 


I  X*’'  ) 

T,  4>  ' 


(3.64) 


If  we  now  define  an  information  loss  L  by 


*■  •  •  *  ♦  •  »  •  »_♦  *  »  (JOj  «  *  (?  I  ♦  •  *  »  •  * 

(5 .*66 )*■ 

k«7  r,  <|> 


■*  4>  *  *  * 


where  we  postulate  that 

L  >  0 


(3.  66) 


by  continuation  of  the  proposition  that  the  information  does  not  exceed  the  input 
entropy,  then 

-L 


p  >  r  e 


(3.67) 


For  a  perfectly  efficient  measurement  we  would  have  L. 


(Nh  (e)  _  E 

v.  <t>  ■ 


0,  which  implies  that 

,  (3.68) 


and  the  detection  criterion  becomes 
P  >  r 


(3.69) 


or 


P  > 


1 


(3.70) 


FA 


The  smallest  that  r  can  be  for  a  meaningful  measurement  is  r  =  2.  For  this  condition 
of  minimum  reliability,  the  detection  criterion  becomes 


t  1 


i  nr  -_  -  -*•--*>  a*®  '■% 


E 


(3.71) 


Since  the  single  noise  waveform  which  enters  the  radar  is  passed  to  ail  of  the 
channels,  the  noise  may  be  correlated  among  channels.  It  will  now  be  shown  that  this 
correlation,  over  the  t-<J>  plane,  is  proportional  to  the  ambiguity  function  |  X(t,  <j>)| , 
which  in  turn,  is  proportional  to  the  noiseless  correlation  surface  |F(t,  ^>)|.  Thi3 
indicates:  (1)  that  the  two-dimensional  matched  filter  essentially  localizes  the  signal 
response  into  the  same  area  shape  as  a  noise  response,  even  in  two  dimensions,  and 
(2)  that  if  the  signal  waveform  design  and  channel  spacing  are  such  that  the  signal 
response  is  predominantly  restricted  to  a  single  channel,  then  the  noise  between  channels 
is  largely  uncorrelated.  The  derivation  for  noise  correlation  using  the  Doppler- 
channel  model  is  as  follows.  Let  v(t)  represent  the  complex  envelope  for  a  Gaussian 
white-noise  input.  (Complex  signal  notation  will  be  employed  and  the  symbol  ''represents 
a  complex  modulation.  )  The  output  from  one  (reference)  Doppler  channel  is 


V  (t)  =  J  v(x)  h  (t-x)  dx 


(3.72) 


.♦  *  '  ras]*o«3«c»-*Tlh&  -eutpuft  o£a*s«<vi«d*Boppl«»»h*»rJ.s«L,«-\vitfc  * 

impulse  response  h 1  (t ),  is. 


V'(t)  =  /  v(y)h'  (t-y)dy 


(3.73) 


The  cross-correlation  between  the  t'vo  outputs  is 


Y(t)  Vs  (t+T)  /  /  v(*)  v(y)  h*  (t-x)  h«  (t  +  t  -y )  dx  dy 


-00  -00 


=  f  J  v  (x)~(x+p)  h  (t-x)h'  (t+T-x-p)  dp  dx,  (3.74) 


-oo  -oo 


where  we  have  transformed  from  the  variable  y  to  p  by 


y  =  x  +  p;  dy  =  dp 


(3.75) 


Now  letting 


q  =  t  -  x;  dq  =  -dx 


(3.76) 


we  obtain 


»*  ■*  «  *•  ♦ 


r,--  -.  -  'Jjj 


41 


s 


00  00 


Rv<t>  =  /  /  7*(x)  v(x  +  p)  h  *(q)  h'  (q  +  t  -p)  dp  dq.  (3.77) 


V  “-oo  “  -oo 

We  identify  the  correlation  functions 


R.(t)  =  v  (t)~(t  +  T) 

y 


(3.78)  . 


for  stationary  noise  y  (t),  and 

.00 
-oo 


Rhh'(z)  =  /-cd  ^**ql  **•'  ^  +  z)dq 


(3.79) 


Then 


Ry<T>  =  f  Rv(P)Rhh.(T-P)dP 
-00 


(3.80) 


which  is  the  convolution  of  R  (r)with  R.  .  .(t).  Now,  for  white  noise, 

v  tin 


R  (t)  =  N  6(t) 


(3.81) 


so  that 


oo 


. . RV(T)*?N;xv^)*=KJ^^r^rqVTrdti-  •  ••*—(*«*• 

-oo 


V  ’  '  o  hh 


*  *  •  •  ■*  ♦  • 


In  the  Doppler -channel  implementation,  the  only  difference  between  the  two  channels 
is  a  frequency  deference  <j>  so  that 


h*(t)  =  h  <t)e 


-j  2  it  <j>  t 


(3.83) 


Then  Eq.  (3.  82 )  becomes 


oo^  ^  -j  2ir  <j>  (q  +  t) 

R  (t)  =  N  R  (t,  <)>)  =  N q  J  h*(q)  h  (q  +  t)  e  dq.  (3.  84) 

Y  Y  -oo 


For  a  matched-filter  system 
h(t)=  l'(P-t) 


(3.85) 


so 


00 


--  _  -j2w  <j)  (q+T) 

R  (t,  4>)  =  No  4  (P-q)  4  (P-q-T)  e  dq 


-j2ir  <|>(t  +  P)  oc  „  *  „  j2ir  x 

=  e  N  J  |  (x)  4  (x-t)  e  dx 


-00 


by  using 


P  -  q  =  x 


(3.86) 

(3.87) 
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and 

dx  -  -  dq  .  (3. 88) 

Then  -j2u  4>x 

1Ry(t,  4>)|  =  Nq  |  J  4(x)£*(x-T)e  dx  |  =  Nq  |  X  (t,  4>)|  ,  (3.89)  „ 

which  was  to  be  shown. 

In  the  preceding  work,  as  well  as  in  the  former  single-channel  analyses,  it  has 
consistently  been  seen  that  a  matched  filter  compresses  the  signal  energy  into  the 
concentration  occupied  by  a  single  noise  mode.  This  property  is  optimum  from  the 
standpoint  of  information  processing.  For  example,  suppose  that  we  consider  the 
compressed  signal  area  to  be  fixed,  and  postulate  that  more  than  one  noise  mode  occurs 
within  the  signal  area.  (This  results  from  a  situation  where  the  matched-filter  time- 
frequency  gate  is  larger  than  the  signal's  input  energy  area.  )  Then  there  would  be 
more  independent  opportunities  for  a  false  alarm  within  the  surveillance  area.  The 
amplitude  threshold  would  therefore  have  to  be  raised,  although  the  received  infor¬ 
mation  (which  depends  only  upon  the  compressed  signal  area  and  the  surveillance  area) 
has  remained  constant.  On  the  other  hand,  we  cannot  compress  the  signal  area  to  less 
*  *  thctrfrti&t  <tf  ldWie? *  bt?ctrtis««tifi*  wos)d  -imply  a  matched*- iilfcar  tir*^  4raq*iejscy*  «  «  ♦  , 

gate  which  is  smaller  than  the  signal's  input  energy  area.  This  situation  tends  to 
expand  the  compressed  signal  as  well  as  the  output  noise  modes.  During  such  ex¬ 
pansion,  the  signal  tends  to  remain  concentrated  within  the  region  of  one  noise  mode, 
but  information  is  decreasing  because  of  the  output  signal  expansion  relative  to  the 
fixed  size  of  the  surveillance  window.  In  summary,  from  the  standpoint  of  information 
efficiency,  the  optimum  filtering  process  is  accomplished  by  the  smallest  time- 
frequency  gate  which  encompasses  the  signal's  input  energy  area  without  substantially 
rejecting  signal  ehergy.  This  is  also  the  basic  characteristic  of  the  matched  filter, 
which  is  known  to  be  optimally  suited  for  detection  and  parameter  estimation. 

3.  3  Relation  of  Results  to  Statistical  Mechanics 

3.3.  1  Distributional  Information  Defined  in  Terms  of  Physical  Entropy 

In  the  preceding  sections,  we  dealt  with  various  radar  problems  and  determined 
equalities  and  inequalities  between  the  parameter  information,  expressed  in  natural 
units,  and  the  SNER  required  to  obtain  it.  By  a  simple  change  of  units,  these  relations 
were  seen  to  be  equivalent  to  relations  between  physical  entropy  and  information  in 
thermodynamic  units.  The  associations  were  such  as  to  suggest  an  equivalence  between 
physical  ertropy  and  information,  of  the  type  specifically  stated  in  Eq.  (3.68).  In 
this  section,  we  shall  be  able  to  acquire  further  corroboration  of  such  an  equivalence 
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by  starting  with  a  thermodynamic  problem  and  deriving  similar  results. 

Consider  a  long  thin  thermally  insulated  container  filled  with  an  ideal 
monatomic  gas,  as  shown  in  Fig.  3.  9»  We  assume  chat  a  stationary  external  energy 
source  is  located  somewhere  along  the  x-axis  within  the  region 


0  <  x  <  X 


(3.90) 


and  its  location  xq  is  to  be  determined.  The  source  injects  a  moderate  quantity  of 
heat  energy  £  in  such  a  manner  that  it  fills  a  subvolume  equal  to  l/q  times  the  total 
volume.  I.  e. ,  the  input  energy  is  concentrated  in  an  interval 


a  X 


*  ♦  *  *  ♦ 


,  (3.91) 

where 

l<q<Q  ,  (3.92) 

with  Q  representing  a  limit  on  how  much  concentration  ran  be  physically  achieved.  A 
subvolume  width  Ax  centered  at  x  =  x*  will  be  called  subvolume  (or  section)  V  (x1 )  . 
Intuitively,  it  would  be  said  that,  if  q  =  1,  no  information  is  received  and  if  q  =  Q,  the 
maximum  information  is  obtained. 

<  *  •*  *  « -  4  4  The^iji^rediiction^if.  a  ft'ceabanponni  *>£.e.nf‘rgy  E  a-eeults*in»a»  e»tno^y*incr^a%e*"V 
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J*  %  Jr, 
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CVW 


q  in  (1.  ) 


(3.93) 


where 


q  A«7  =  temperature  rise  in  subvolume  V(xq) 
w/q  tt ■  weight  of  gas  in  subvolume  V(xq) 


specific  heat  at  constant  volume. 


If  no  information  Were  obtained,  then  q  =  1  and  the  entropy  will  be  denoted  by  the  un¬ 
primed  value 


A  V 


A  S  =  S  w  In  (1  +  _ 

P  v  3, 


) 


(3.  94a) 


tt 


Cy  w  A? 


A? 


-& —  for  -x —  «  1 

J0  JQ 


(3.94b) 
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and  it  should  be  observed  that 


A  r 


A  S 1  <  Sp  for  q  >  1 .  .  (3 . 95 ) 

The  quantity  will  be  referred  to  as  the  entropy-equivalent  of  the  input  energy,  or 
simply  the  input  entropy. 

We  note,  now,  that  a  greater  amount  of  received  information  (higher  q)  implies 
a  smaller  entropy  rise  AS'.  Since  entropy  represents  unavailability  of  work,  it  is 
immediately  concluded  that  more  input  information  implies  a  greater  availability. of 
work.  This  result  is  completely  compatible  with  the  described  gas  model.  For  ex¬ 
ample,  if  the  input  energy  is  introduced  uniformly  throughout  the  total  volume,  no 
information  is  received  and  the  thermal-equilibrium  state  of  the  system  is  not  disturbed 
so  that  there  can  be  no  further  thermal  work  performed  due  to  mixing  or  diffusion. 

On  the  other  hand,  the  more  the  fixed  quantity  of  energy  E  is  concentrated  as  it  enters 
the  container,  the  higher  the  local  temperature  rise  in  subvolume  V(xq)  and  the  more 
thermal  work  we  can  expect  to  recoup.  In  fact,  it  is  proved  in  Appendix  B  that  if  the 
added  heat  is  subsequently  allowed  to  mix  with  the  remainder  of  the  volume,  then  the 
entropy  increases  by  an  amount 

N  =  Sp  -  AS’  (3.96) 

*  a„s.the  receive^  information  _in  concurrently  lost.  We  shall  associate  N  with  information 
and  it  will  be  called  negentropy.  For  a  specific  quantity  of  input  energy,  'here  then 
exists  a  principle  of  conservation  of  information  and  entropy  such  that 

S  =  AS'  +  N  =  ~  .  (3.97) 

p  "o 

E 

To  review,  for  a  given  energy  E  there  exists  an  entropy -equivalent  S  =  — x —  , 

P  JQ 

assuming  A«7  «  <JQ.  When  E  is  introduced  into  suDvolume  V(xq)  ,  the  increase  in 
system  entropy  is  AS'.  We  also  state  that  a  further  quantity  N  is  received,  which  is  a 
distributional  form  of  entropy  identified  with  positional  information,  and  which  is  ex¬ 
changed  for  a  further  increase  in  entropy  as  the  added  energy  E  diffuses  throughout 
the  volume  (and  information  is  lost).  It  is  an  interesting  characteristic  of  this  type  of 
information  that  a  greater  input  information  implies  a  greater  amount  of  available 
thermal  work.  In  this  sense,  the  information  tak*  s  on  the  attribute  of  a  physical 
entity  rather  than  only  an  arbitrary  measure,  which  is  a  fundamental  conclusion  of  a 
cybernetic  nature. 

Although  the  negentropy  N  has  t'-  s  far  been  associated  with  a  measure  of 
information,  we  have  not  yet  related  N  co  the  type  of  information  discussed  in  the 
radar  application.  This  relation  will  now  be  clarified.  From  Eqs.  (3.96),  (3.  93)  and 
(3.  94a),  we  have 
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N 

F rom  the 


—  C  w  - 

=  C  w  In  (1  +  ) - ”■ —  In  (1  +  q  ^ —  ) 

v  ?o  9  ?o 

theory  of  statistical  mechanics,^®  it  is  known  that 

_  kn  . 

C  w  =  =  k  m 

v  2 


(3.98) 


(3.99) 


where 

k  =  Boltzmann's  constant 

n  =  total  number  of  degrees  of  freedom  in  overall  volume 
m  =  total  number  of  modes,  assuming  two  degrees  of  freedom  per  mode. 


Thus, 


N  =  k  m  In  (1  + 


A? 


)  -  m'  In  (1  + 


q  A  .7 


(3.  100) 


where 

m' 


—  =  number  of  modes  in  subvolume  V(x  ). 

q  ° 


(3.  101) 


But,  from  Eq.  (3.  94b)  and  Eq.  (3.99), 


where 


A  V 

?o 


E 


b.NER 

m 


SNER  =  =  p' 

K^o 


(3.  102) 


(3.  103) 


Thus, 


N  =  k  mln(U 


m 


)  -  m'  In 


(3.  104) 


This  formula  for  negentropy  bears  a  remarkable  similarity  to  Shannon's  formula  for 
the  information  capacity  of  a  noisy  communication  channel,  which  will  be  further  dis¬ 
cussed  in  the  subsequent  section.  We  note  here,  however,  that  N  approaches  zero  as 
p'  approaches  zero.  Also,  if  m'  is  very  small  compared  to  m  so  that  the  second  term 
is  negligible  (greattst  received  information),  and  if  m  is  very  large,  then 

N»k  p'  ,  (3.105) 


which  shows  that  the  greatest  received  information  is  characterized  by 

^WSNER«rJr-  .  (3.106) 

*  K.y  0 

Comparison  of  this  result  with  Eq.  (3.  68)  or  Eq.  (3.54)  shows  that  we  should  identify 
N  with  information  in  thermodynamic  units  or  N/k  with  information  in  natural  units. 


« 
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3.3.2  Comparison  with  Shannon's  Formula  for  the  Information  Capacity 
of  a  Noisy  Channel 


(e ) 

From  Eq.  (3.  104),  it  is  seen  that  the  distributional  information  N  =  N 


(in  natural  units)  is  measured  by  a  change  in  the  quantity 


N(e,(m)  =  m  In  (1  +  -£-  ) 
'  m 


(3.  107) 


for  a  fixed  value  of  p'.  That  is, 

N(e>  =  N(e,(m)  -  N(e,(m') 


(3.  108) 


(e)  (e) 

We  associate  N  (m)  with  an  a  priori  value  of  information  entropy,  and  N  '(m*  )  with 


an  a  posteriori  value  of  information  entropy,  the  difference  being  information. 
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For  comparison,  consider  Shannon's  formula  *  for  the  information  capacity 
of  a  noisy  channel: 

,  (e) 


R’ 


=  Bc  1”  (1  +  S/N) 


nits/ sec 


(3.  109) 


where 


B  =  channel  bandwidth 
c 


S/N  =  signal-to-noise  power  ratio  per  transmitted  pulse. 

In  a  time  duration  T,  the  amount  of  amplitude  information  communicated  is 

l(e)  _  R<e)T  _  TB  In  (1  +  S/N)  natural  units. 


(3.  110) 


Now  let  us  assume  hat  a  sequence  of  sinusoidal  pulses,  each  of  duration  P,  is  being 
transmitted,  and  they  are  received  by  a  matched  filter  naving  a  bandwidth  of  B  =  l/P, 
as  in  Eq.  (1.5).  Then,  from  Eq.  (1.6), 


S/N  =  SNPR  =  jjj- 
o 


(3.  Ill) 


where 


E'  =  energy  of  a  single  pulse 


Nq  =  k?  =  noise  power  spectral  density. 


Across  the  channel  bandwidth  Bc>  we  can  fit  a  parallel  group  of 


B 

=  PB 

•B  c 


pulses 

and,  in  a  time  T,  there  are  T/P  such  pulse  groups  giving  a  total  of 


(3.  112) 
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PBc  •  p  =  TBc  pulses  .  (3.113) 

(Alternatively,  we  could  have  transmitted  pulses  of  bandwidth  Bc  and  would  have  also 
ended  up  with  TBc  pulses  for  matched-filter  reception.  )  Therefore,  Eq.  (3.  Ill)  can 
be  written  as 

S/N  =  -^r-g  =  T  B  ~  ’  (3*114) 

c  c 

where 

E  =  total  energy  of  the  signal. 

Finally,  substitution  of  Eq.  (3.  114)  into  Eq.  (3.  110)  yields, 

I*e)  =  m  In  (1  +  -^  )  =  I(e)(m)  ,  (3.115) 

where 

m  =  TBc  =  number  of  noise  modes  in  the  time -bandwidth  area  occupied  by 
the  message. 

For  a  fixed  balue  of  p*  (i.  e. ,  fixed  total  energy),  the  information  I'  '  is  a  function  of 
on1/  the  number  of  modes  m.  Distributional  information,  as  expressed  by  Eq.  (3.  108), 

is  therefore  seen  to  be  the  difference  between  N^e\m)  for  the  a  priori  surveillance 

(e)  - 

region  and  N  (m1 )  after  reception.  In  a  matched-filter  radar,  m*  =  1  so  that 


Nte)  =  m  In  (1 +-^  )  -  In  (1  +  p’ )  =  H  ^e)  -  H,  .  (3.116) 

m  3.  d 

Thus,  after  the  measurement,  we  are  still  left  with  an  a  posteriori  uncertainity 
(entropy)  given  by 

Hb(e)  =  In  (1  +  p' )  .  (3.  117) 

Now,  Eq.  (3.  115)  indicates  that  this  is  the  information  that  can  still  be  extracted  from 

the  matched-filter  output  (for  a  signal  immersed  in  one  noise  mode).  In  fact,  this  is 

the  amplitude  information  about  the  signal.  Thus  H„v  the  a  priori  entropy,  is  the 

-  e  a -  /e» 

sum  of  a  distributional  information  term  Nv  '  and  an  amplitude  information  term 

The  generality  and  applicability  of  physical-entropy  and  information-entropy 

concepts  to  both  thermodynamic  problems  and  electrical  problems  stems  from  the 

use  of  universal  properties  such  as  energy,  temperature  and  degrees  of  freedom.  In 

fact,  the  Boltzmann  factor  has  been  shown  to  be  completely  applicable  to  a  hybrid 

system  such  as  a  mechanical  (leaf-spring)  resonator  immersed  in  a  container  of  gas. 

53-55 

The  spring  is  characterized  by  amplitude  and  phase  properties  and  comprises 

two  degrees  of  freedom  as  a  harmonic  oscillator. 


i 


& 
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3.  3.  3  A  Signal-Detection  Criterion  Relating  Input  Physical  Entropy  to 
"Absolute"  Information  Entropy  of  Noise  Background 

It  is  assumed,  here,  that  the  signal  is  immersed  in  one  noise  mode,  as 
at  the  output  of  a  matched  filter.  From  an  equation  such  as  Eq.  (3.  2),  we  have 


l  -  U  -  P1A)  =  PL 


(•!.  118) 


Substituting  Eqs.  (3.  5)  and  (3,  6),  it  is  seen  that 


=  In  r 


(3. 119) 


The  minimum  useful  value  of  r  is  2  and  therefore  the  threshold  of  detectability,  by 
this  criterion,  is  given  by 


=  In  2  =  0.  74 


(3. 120) 


With  a  slight  increase  in  reliability  to  r  -  e,  we  shall  (reasonably)  define  the  detecti- 
bility  by  the  criterion 


=  In  e  =  1 


(3. 121) 


Now  the  energy  of  the  noise  mode  is  characterized  by  the  normalized  Boltzmann 

factor  of  Eq,  (2.16).  If  the  energy  levels  were  quantized  to  a  fine  interval  6E,  the 
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information  entropy  would  be  approximately  ' 


oo 

J  P(E)  ln[p(E)  6E]  dE 


=  1  +  In  k  -  In  6E 


(3. 122a) 
(3. 122b) 


by  substitution  of  Eq.  (2, 16).  By  using  the  natural  quantization 
6E  =  =  k? 

Eq.  (3.122b)  reduces  to 


f(«)  - 


natural  unit 


(3.123) 


(3. 124) 


Therefore,  from  Eqs.  (3.121)  and  (3.124),  the  signal  detectability  threshold  is  given  by 


T  -  H(C)  -  1 
W  '  N  -  1 


(3. 125) 


where  will  be  referred  to  as  the  "absolute"  information  entropy  of  the  noise  mode. 


'V 
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The  thermodynamic  equivalent  to  Eq.  (3. 125}  is 

ET 

-T  ’  (hn>* 


(3. 126) 


where  is  the  physical  entropy  increase  due  to  signal  and  (H^)^  is  the  absolute 

information  entropy  in  thermodynamic  units: 


<HN't  =  kHNe) 


(3. 127) 


In  order  to  interpret  the  results,  it  should  be  recalled  that  information  entropy  is  funda- 
52 

mentally  defined  as  a  generalization  of 


H 


(e)  _ 


=  -  In  P  =  In  N 


(3. 128) 


where  N  =  l/P  is  a  number  of  alternative  equally-likely  states.  Therefore  (H^)^ 
represents  the  average  value  of  the  logarithm  of  the  number  of  distinguishable  noise 
amplitudes  (subject  to  quantization  6E  =  cf^  ).  Eq.  (3.128)  states  that  the  physical  en¬ 
tropy  increase  from  the  si, .rial  must  exceed  the  value  (Hj^  in  to  be  detected. 

This  is  consistent  with  a  well  known  result  of  statistical  mechanics  which  relates  the 
thermodynamic  entropy  to  the  logarithm  of  the  number  of  system  states  or  "complex¬ 
ions1*  .  That  is,  assume  that  a  system  is  in  a  condition  such  that  n^  degrees  of  freedom 
are  in  energy  level  E^,  n ^  degrees  of  freedom  are  ir  energy  level  E 2, , , . ,  n^  degrees 
of  freedom  are  in  energy  level  Ej^.  The  number  of  ways  in  which  this  can  occur  is 

nl  ,  (3.129) 


F1  = 


nI 1  n2 1  *  *  *  \l  ’ 


as  given  by  Eq.  (2.  8),  where  n  is  the  total  number  of  degrees  of  freedom.  Let  us  add 
a  small  quantity  of  energy  E  such  that  one  degree  of  freedom  in  level  E .  jumps  to  a 


higher  level  E.,  with 
°  J 


=  E.  -  E. 
J  i 


Then  the  number  of  ways  that  the  new  situation  can  occur  is 

„  _  nl _ 

*2  nxl . . .  {'n.'- 1)  | . . .  (m  +1)1 . .  .n^. 


Now 


**7 


n. 


n. 


w 


n 


J 


for  n.  »  1 
J 


(3. 130) 


(3. 131) 


(3. 132) 


The  system  is  in  thermal  equilibrium  before  and  after  th"  introduction  of  the  energy  E 
so  the  Boltzmann  factor  of  Eq.  (2,12)  applies.  That  is, 


i 
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n 

p(E.)  =  -1  a 

r\  £1  n 


1=1.: 


M 


Therefore  Eq.  (3.132)  becomes 


(3. 133) 


and  so 


E.  -E. 


In  -  In 


(3. 134) 


(3.135) 


Thus,  physical  entropy  is  inherently  related  to  the  logarithm  of  the  number  of  alterna¬ 
tive  states  by  virtue  of  the  applicability  of  the  exponential  Boltzmann  factor.  The  de¬ 
tectability  criterion  of  Eq.  (3. 125)  therefore  is  predicated  upon  the  minimum  energy 
that  must  be  added  to  overcome  the  degree  of  randomness  in  the  noise,  as  measured  by 
the  quantity  a^,  =  k.  7  . 


t 


52 


4.  OPTIMIZATION  OF  AMPLITUDE  THRESHOLD  LEVEL 

4, 1  Motivation  for  Amplitude -Threshold  Optimization 

In  the  previous  radar  discussions  dealing  with  the  nonlinear  Bessel-function 
detector,  when  the  input  SNER  was  equal  to  the  information  as  expressed  by  Eq,  (3.  68), 
the  reliability  factor  r  was  equal  to  two  times  the  SNER,  for  a  barely  detectible  signal, 
as  indicated  in  Eq,  (3.  69).  Now,  from  Eqs.  (3.  97)  and  (3. 116)  we  may  write 

=  N(e)  +  In  (1  +  p»)  ,  (4.1) 


where 


(e) 

N'  '  =  distributional  information  obtained 


AS1  =  ln(l  +  p* )  =  amplitude  entropy  (not  yet  extracted  after 

pulse  compression). 

If  we  associate  Eq,  (4. 1)  with  the  radar  receiver  employing  the  linear  detector, 


=  In  r  TBPW  =  In  TBPW  +  lnr 


=  I*e)  +  In  (1  +  p1 ) 


where 


1^  =  In  TBPW  =  distributional  information  of  linear  system  (4.  3a) 


r  =  1  +  p*  =  1  +  SNER 


(4.  3b) 


Thus,  with  the  nonlinear  detector,  all  of  the  entropy  increase  appears  in  the  form  of 
distributional  information  for  the  maximum  reliability  (to  allow  detection)  of 

r  =  p  =  2p«  ,  (4.4) 

whereas,  with  the  linear  detector,  the  entropy  increase  may  be  interpreted  as  equiva¬ 
lent  to  the  sum  of  distributional  information  plus  amplitude  information,  with  a 
measurement  reliability  of  r  =  1  +  p*  .  In  both  cases  p*  >  1  implies  r  >  2  ,  as  is  re¬ 
quired  for  a  meaningful  measurement.  It  is  intuitively  consistent  that  no  amplitude 
information  is  conveyed  with  the  nonlinear  detector  because  Eq,  (3.  38)  shows  that  it 
is  necessary  to  know  p  before  we  can  implement  the  nonlinear  detector  and  therefore  no 
amplitude  information  should  be  expected. 

With  either  the  linear  or  nonlinear  detector,  the  reliability  r  increases  with 
SNER  =  p>  ,  as  expressed  by  Eqs,  (4,  3b)  and  (4.4).  This  implies  an  increase  in 
threshold  value  by  virtue  of  Eq,  (3,  56) ,  which  is 


iscaaMgfisfligagM- 
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=  In  rTBPW 


The  conclusion  that  the  threshold  level  is  an  increasing  function  of  SNER,  in 
order  for  the  equivalence  of  physical  entropy  and  information  to  hold,  raises  the  ques¬ 
tion  of  possible  optimization  of  the  amplitude  threshold  for  a  given  SNER,  It  is  shown 
in  this  chapter  that  such  an  optimum  level  exists  and  can  be  usefully  employed  in  an 
efficient  radar  detection  procedure.  It  may  also  be  observed,  at  this  point,  that  the 
information  InTBPW,  defined  for  the  linear  detector,  does  not  increase  with  SNER, 

This  may  appear  inconsistent  from  the  viewpoint  that  the  measurement  accuracy  in¬ 
creases  with  SNER  as  indicated  by  Eqs,  (3.  27)  and  (3,  28),  although  the  resolution  does 
not.  However,  we  are  restricting  our  definition  of  positional  information  to  a  •bound" 
form  in  which  a  physical  compression  of  energy  is  actually  involved.  From  this  stand¬ 
point,  the  nonlinear  Bessel  function  detector  allows  the  information  to  increase  as 
InpTBPW  while  the  linear  detector  causes  the  information  to  remain  constant  with  in¬ 
creasing  SNER, 

4.  2  Detection  Model 

It  is  first  assumed  that  the  input  signal-to-noise  ratio  is  known,  although  a  later 
extension  of  the  results  will  show  that  the  analysis  can  be  employed  for  a  given  range 
of  possible  values  of  signal-to-noise  ratio.  In  this  procedure,  we  adopt  the  modal  of  a 
binary  input  message  x.  which  has  two  equally  likely  states: 


x  =  0 

o 

x!  =  1 


target  absent 
target  present. 


At  the  output  of  a  "black  box*  ,  which  includes  a  voltage -amplitude  threshold  test, 
we  obtain  a  binary  result  y^  : 


y  =  0 

*o 


The  model  is  depicted  in  Fig,  4, 1, 


target  judged  absent 
target  judged  present. 


A  detection  information  1^  may  be  defined  as 

.(2)  _  h(2)  _  „{2) 


where 


r<2)  . 


Ha  ”  Hb 


=  -  T,  p(x.)  log,  p(x.)  =  a  priori  entropy 

a  i  =  0  - 

1  1 


2  n  2  n  p<xi»yj>  lo®2  D<xAj> 

i=0  j=  0  J 


=  a  posteriori  entropy. 


(4.8) 


THRESHOLD 

ESTIMATION 

PROCEDURE 


xQ  =  TARGET  IS  NOT  PRESENT 
x,  s  TARGET  IS  PRESENT 


y0= TARGET  JUDGED  NOT  PRESENT  , 
y  =  TARGET  JUDGED  PRESENT 


Fig.  4. 1  Detection  Model 


|  ' 

b 


The  a  priori  entropy  H_  is  a  constant  independent  of  amplitude -threshold  level.  The 
“  1  3* 

maximization  of  information  with  .•  . .  ;:ect  to  threshold  level  is  therefore  seen  to  be 
accomplished  by  the  minimization  olihe  a  posteriori  entropy,  which  we  may  write  as 


42'  P(yj)  ["i?  0  P<*llyj’  1082  p(xi/yj)] 


(2\ 

Minimization  of  H  ^ 1  is  equivalent  to  minimization  of  the 


=  -£oP(*i/yj)  log2P(xi/yj);  j  =  0,1 


(4.10) 


averaged  over  the  p(y.).  Finally,  minimization  of  the  Q.  is  accomplished  by  producing 

J  J 

the  greatest  disparity  between  p(x  / y.)  and  p(x./ y.),  for  j  =  0  or  j  =  1  (since  Q.  is 

^  J  J  J 

itself  an  entropy  form  for  two  states,  with  maximum  entropy  being  characterized  by 
52 

equal  probabilities  ),  That  is,  given  y^,  we  have  maximized  the  likelihood  of  distin¬ 
guishing  whether  a  target  is  absent  (xq)  or  present  (xj),  where  these  two  possibilities 
were  equally  likely  before  the  threshold  test. 


can  be  written  in  terms  of  the  joint  probabilities  as 
(2)  ^  ^  p(xi»yi) 

H»  ■  20p(Xi,yi’  1082  'flvrj)  W 

where  the  joint  probabilities  are  given  by 

p(xi»yj)  =  p(xi)  p(yj/  xi>  =  4*  P(yj/Xi> 


(4.U) 


(4. 12) 


p(x0)  =  p(*i)  -  ~2 


(4.13) 


The  conditional  probabilities  pty^/x.)  may  be  recognized  in  more  familiar  terms  as 

p(y^/xQ)  =  PpA  =  false -alarm  probability  (4.14a) 

p(y^/ Xj )  =  Pp  =  detection  probability  (4, 14b) 

p(yQ/xQ)  =  =  1-Pp^  =  correct-dismissal  probability  (4.14c) 


p(y0/xi>  =  Pj 


=  i-p 


P  =  missed- signal  probability 


(4. 14d) 


Using  Eqs.  (4.  7),  (4. 11) ,  (4, 12)  and  (4. 14),  we  can  now  write  Eq.  (4.  6)  in  the  form 

1  °  =  1  +  ‘PD  l0p82  +  P^A  l08|  -PJ%T 

*  PM  +  Pcd1°8  PM  +CpCD  ’  * 


9 


(4.15) 
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which  can  be  minimized  with  respect  to  amplitude  threshold  level.  Typical  plots  of 

(21 

VJ  vs.  threshold  level  are  presented  in  Section  6.2,2,  Fig,  6.5.  The  curves  become 
higher  and  broader  with  increasing  signal-to-noise  ratio.  For  a  given  input  signal-to- 
noise  ratio,  it  can  be  seen  that  there  is  an  optimum  threshold  level  which  maximizes 
the  detection  information.  In  the  example  cited  in  Section  6.  2.  2,  it  can  be  seen  that 
the  optimum  ratio  of  threshold  voltage  to  rms  noise,  x^,  =  — 1- ,  is  not  a  sensitive 

function  of  signal-to-noise  ratio.  As  a  general  rule,  however,  if  we  may  reasonably 

\ 

assume,  a  priori,  a  range  of  possible  signal-to-noise  ratios,  then  the  amplitude 
threshold  can  be  set  at  some  average  value  such  as 


_  / * (Dmax{S/N)  *T(S/N)  d<S/N> 

Xj,  —  . 

f  I ^  (S/N)  d(S/N) 

Dmax 


(4.16) 


where 

1^  (S/N)  =  peak  value  of  1^  for  a  specified  signal-to-noise  ratio  S/N  , 

Dmax 


and  the  integrations  are  performed  over  the  a  priori  expected  range  of  S/N  values. 

On  the  other  hand,  a  radar  c  signer  may  wish  to  sacrifice  some  information  at  the 
higher  S/N  values  and  increase  the  information  for  the  lower  S/N  values.  Inspection 
of  curves  of  the  type  illustrated  in  Fig.  6.  5  will  then  allow  a  well-compromised  selec¬ 
tion  of  threshold  level. 

4.  3  A  Detection  Procedure  Based  Upon  Threshold-Crossing  Rate 

After  one  chooses  the  optimum  amplitude  threshold  in  accordance  with  the  cri¬ 
terion  described  in  the  previous  section,  a  specific  false  alarm  rate  is  obtained  which 
must  be  accepted  as  normal.  This  rate  may  be  empirically  determined  as  accurately 
as  desired  by  Observation  over  a  long  period  of  time  while  the  radar  is  in  standby  opera¬ 
tion  barring,  of  course,  variations  in  equivalent  noise  temperature  due  to  antenna  point¬ 
ing  angle,  etc.  Detection  must  now  be  based  upon  an  increase  in  threshold— '  i  "is sing 
rate  resulting  from  the  presence  of  signal. 


A  detection  procedure  is  postulated  in  which  an  output  "indicator"  pulse  is 
generated  if  there  are  one  or  more  amplitude -thre shold  crossings  per  radar  pulse. 
Within  some  observation  interval  T  ,  which  includes  many  transmitted  pulses,  we 
observe  the  rate  at  which  the  indicator  pulses  occur.  If  noise  alone  is  present,  the 
probability  of  exactly  k  indicator  pulses  occurring  in  time  T  is,  by  the  binomial  dis¬ 
tribution, 

/  ur  \  _ 

n-k 


P(k) 


■Q* 


(1  "  Pc> 


(4. 17) 


i 


57 


sr 


fv 

It 


.~7S .-5P-  STS*-. 


where 


=  Pp^  Per  transmitted  pulse  a  n  Pp^»  where  n  is  the  number 
of  noise  modes  per  transmitted  pulse  in  the  surveillance 
region  and  Pp^  is  the  probability  of  a  single  noise  mode 
crossing  the  threshold 


n  = 


f  T  =  number  of  transmitted  pulses  in  time  T  at  a  pulse 
repetition  frequency  of  f  . 

Using  the  normal  approximation  that 


for 
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P(k)  «  N  (n  p0,  npQ  (1  -  pQ)  ) 


n  Po  (1  “  Po>  ^  3 


and  writing  the  indicator  pulse  rate  as 


r  = 


k 

T 


(4.18) 


(4.19) 


(4.20) 


it  is  seen  that  the  probability  density  function  for  rate  with  noise  alone  is  approximately 


P.M  - 


N(£r"“o  • 


fr  Po^Pq) 


(4.  21) 


When  signal  is  present,  the  indicator  pulse  rate  increases  and  essentially  (for  n  »  1) 
becomes  equal  to  (a)  the  false  alarm  rate  and  (b)  the  rate  with  signal  pre  sent  but  no 
false  alarms  included.  This  new  rate  has  the  distribution  of  the  sum  of  two  independ¬ 
ent  normal  variables  and  is  therefore 


Pl(r>  =  N  frPo  +fr  pl» 


f  p  (1  -  p  ) 
r  ro  '  ro' 


*r  Px  (1  “  PL) 


(4.22) 


where 


Pj  =  Pp  per  transmitted  pulse. 


The  two  rate  density  functions  (signal  absent  and  signal  present)  are  illustrated  in 
Fig.  4.2. 

A  threshold  rate  r„  may  now  be  set  using  the  Neyman-Pe arson  procedure  in  the 
rate  domain.  An  overall  false  alarm  probability  Pp^  is  selected  for  a  specified  obser¬ 
vation  interval  T.  Since  the  standard  deviations  of  the  density  functions  Pfr)  and  P,(r) 

U  1. 

become  narrower  with  increasing  T  ,  the  rate  threshold  r„  decreases  with  increasing 


T  fee  a  fixed  overall  P 


FA  * 


With  a  given  signal -to-noise  ratio,  then,  the  overall 


detection  probability  P^  will  increase  with  T  .  The  detection-information  procedure 


Fig.  4*  2  Probability  Density  Functions  for  Indicator  Pulse 
Rate,  with  Signal  Absent  and  Signal  Present 


is  illustrated  numerically  in  Section  6.  2.  2,  using  the  actual  parameters  of  an  advanced 
pulse  compression  radar.  It  was  found  to  be  substantially  more  efficient  than  the  con¬ 
ventional  approach  in  which  the  Neyman-Pearson  procedure  is  applied  in  the  amplitude 
domain.  Some  reflection  on  the  nature  of  the  difference  between  the  two  approaches 
will  indicate  how  the  improvement  occurs.  In  the  detection -information  procedure, , 
we  have  disassociated  the  overall  false  alarm  and  detection  probabilities  from  the  am¬ 
plitude  threshold  setting  which  is  optimally  set  by  an  independent  criterion.  It  is 
readily  seen  that,  under  conditions  of  long  observation  time  T  and  low  overall  false 
alarm  probability  Pp^  *  the  normal  Neyman-Pearson  procedure  applied  to  amplitude 
may  require  amplitude  thresholds  which  are  so  high  as  to  be  completely  unsuited  for 
low-level  signal  detection,  whereas  the  detection-information  procedure  always  chooses 
a  well-compromised  threshold. 


5.  PARAMETER  INFORMATION 


5.1  Basic  Formula 


In  the  previous  chapters,  particularly  Chapter  3,  the  strict  applicability  of  the 
concepts  of  information  theory  to  radar  was  developed  by  utilizing  well  known  results 
on  the  size  of  the  compressed  signal  responses,  as  illustrated,  for  example,  by 
Fig.  3.5  with  the  linear  detector  and  Eqs.  (3.32)  and  (3,33)  for  the  Bessel-function 
detector.  The  basic  framework  developed  previously  can  be  generalized  to  include 
multiple  targets  with  unknown  echo  amplitudes,  range  delays  and  Doppler  shifts.  The 
generalized  results  not  only  support  the  previous  conclusions,  but  they  lead  to  a  con¬ 
sideration  of  information  areas  in  the  t  -  4>  plane  as  well  as  the  definition  of  an  inter¬ 
dependence  coefficient  between  range  and  Doppler  informations.  In  this  section,  we 
derive  the  basic  formula  for  parameter  information  in  a  multiple -target  environment. 
The  following  sections  are  devoted  to  simplifications  and  interpretations  of  the  basic 
formula.  We  sh;  11  use  the  analytical  model  and  complex  notation  employed  in  Fig.  3.  4. 
Let  it  be  assumed  that  there  are  N  targets,  and  let 

Sea  *  *  ’*N^  a  ^’1*^1*  ^1*  T2,<^2,'^2’**  *  ’  TN’  ^N’^N^  (5»1) 

be  a  vector  (3N -tuple)  representing  the  range,  Doppler  and  amplitude  parameters  of 
the  N  targets.  If  the  transmitted  Signal  is  |(t),  then  the  complex  echo  voltage  is 


tlx  ft>  =  2,  tlx  , 
x0  iel  Xoi 


where 


^x  <*>  =  Aoi  *  ft  “Toi>  e 


j2in|»  .t 


in  which  the  zero  subscript  represents  a  true  value. 


y=  ;(t)  *  tu  (t)  +  v(t)  ,  (5.4) 

o 

represents  the  received  noisy  signal,  where  v(t)  is  noise,  then,  by  the  Bayes  equality, 


we  have 


nave 

e  average  parameter  information 

(e)(X.Yl  =  P  P  nfx.vllnE^ 


(5.5) 


i  therefore 


^(e)  (X,Y)  a  /*  /%(x, y)lnE|^dxdy  =  /^p(x,y)ln£^Ldxdy  .  (5.6) 
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Substituting, 


and 


P(x,  y)  =  p(x)  p(y/x) 


P(y)  =  /  P(x)  P(y/x)  dx 

-CD 

the  information  becomes 

(e) 


(5.  7) 
(5.8) 


Ipe;  (5C»Y)=  J  p(x)dx  J  p(y/x)  In 


oo 

CD 


i  00 
L  f  p(x'  )p(y/x«  )dx' 

-00 


p(yA) 


dy  ,  (5. 9) 


which  is  entirely  in  terms  of  the  a  priori  density  function  p(x)  and  the  likelihood  func¬ 
tion  p(y/x).  In  the  analytical  work  dealing  with  information,  it  is  most  desirable  to 
investigate  the  change  in  information  as  a  consequence  of  changes  in  the  target  con¬ 
figuration  and  changes  in  radar  Waveform.  In  order  to  allow  for  the  former  considera¬ 
tion,  the  averaging  with  respect  to  p(x)  in  Eq.  (5.  9)  may  be  omitted  and  the  formula 
become  s 


Ij|e)  (x,Y)=  f_  p(y/x) 


00 

r 

-00 


In 


CD 


p(yA) 


/  P(x*  )p(y/x‘ )  dx'  . 
-00 


dy 


(5. 10) 


In  terms  of  the  complex  radar  notation,  we  have 

p(y/x)  =  p  (v(t)  e  ;(t)  -  nx(t)  )  =  p  (v(t)  =  y  -  11x(t)  ) 

=  P  (vx,yW  =  IM  '  nxW  )  t  P(-X,y) 

where,  (from  Eq,  (3,  20) 

1 


(5.11) 


-  2k?  Ima>  lvx,y(t)!2dt 


P(vv  J  = 


X‘y  (2irk?W* ) 


TTWT 


(5.12) 


with 


lvx,y(t)l  =  l^(t)  *  T1  x^>  1 2  =  kWl2  -  2  Re  rix(t)  +  |  r,x(t)  | 2.  (5. 13) 
Thus,  Eq,  (5, 10)  becomes 

l‘e)(X.V)  -  /V  y)  1»| 


P(vx>y) 


00 

1.  /  p(x’ )p(vx,  )dx» 
-00  *  * 


dy 


(5.14) 


For  the  integration 


/  P(x* )  p(v  ,  )  dx' 

-CD  ,y 


(5.15) 


\ 
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x'  is  an  arbitrary  variable  of  integration  and  we  have 
vx«  ,y  =  vx»y(t)  =  ^{t)  ‘  ^x*  (t) 

=  VX,  y ^  +  *1  XM  "  Tl  x*  ^ 


(5. 16) 


where  x  is  a  given  set  of  parameters  throughout  the  problem  and  all  averaging  is  being 
done  over  the  ensemble  of  all  possible  received  waveforms  y  =  £,(t)  as  determined 
from  the  multidimensional  Gaussian  process  v(t)  added  to  the  given  r\  x(t)  .  Substituting 
Eq.  {5. 16)  into  Eq.  (5. 14)  yields 


I^2)(x,1f)=  /  p{v  )ln 
-00 


P^vx,  y^ 


(5. 17) 


•  /  P(x,)P(vx>y+T1x"T1x»)dx, 


First  consider 


P^vx, y  +  ^x  “  ’lx*  ^ 


'TEy  I  lvx,yW+Tlx(t)'Tlx‘{t)l‘ 


(2ttU  W‘)‘ 


(5. 18) 


where 


lvx,y^ +T1x^  “  1lx»^|2  =  . 

x,y  .  (5.19) 

| vXj y(t) 1 2  +  2  Re  v*>y(t)  (-nx(t)-Tixl  (t)  )  +  |rix(t)  -  qx,  (t)|Z 

For  wide-band  signals,  the  center  cross- cor  relation  term  involves  a  cosine  function 
of  a  wide-band  phase -modulation  argument  as  well  as  a  uniformly-distributed  phase 
due  to  wide-band  noise.  After  integration  with  respect  to  time,  this  contributes  a 
negligible  value  to  the  total  exponent  in  Eq.  (5. 18).  Thus 


P(vx,y+Tlx'11x',» 


(UkSW*)- 


(lvx,y(t)|2+ITlx(t)'Tlx«(t)|2  )  dt 

JTW  6 

~~2 FyJ  hx(t) "  ^x' {t)l2  dt 

a  -co 


(5.  20) 


«p(vx,y)e 

and  the  integration  with  respect  to  x'  in  Eq.  (5. 17)  becomes 


co  oo  ~’2£$  I  lnx(t)-ilx,(t)|2  dt 

f  P(x’  )p(vx  v+t1x-T)x,  )dx«  =  p(v  )  f  p(x'  )e  dx' .  (5. 21) 

-co  ,Y  ’ y  -oo 
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Substituting  this  into  Eq.  (5.17)  yields 

£’<*•« = -  r  p(vx>y) 

r  -no 

00 

/  p(*M 


=  -  In 


oo  "Z Zjf  f 

/  p(x* )  e 

-CO  m 

/  UxW-hx.  wl2dt 

#  —  oo 


dx* 


dx' 


dy 

(5.  22) 


Now, 


\  / J  n  x(t)  -  h  x,  W  r 2  dt  =  Y  /  J  h x(t)  1 2“ 2  Re  v (t)  ^  X« (t)  + 1  • 1  x«  M 1 : 2  ) dt 

(5.  23) 

(5.  24) 

(5.25) 
(5.  26) 

Using  the  above  notation,  Eq.  (5.  22)  can  be  expressed  in  the  form 

E*+E  1  „ 

,  oo  'I —I??****,* 

Ip  (x.Y)  *  -  In  J  e  e  p(x» )  dx»  ,  (5.27) 

^  -OO 

which  is  a  general  formula  for  parameter  information  that  depends  only  upon 

(1)  The  assumed  target  situation  x 

(2)  the  ratio  of  total  echo  signal  energy  to  noise  energy  per  mode 

(3)  the  multiple -target  echo- signal  ambiguity  function  Xx  x, 

(4)  the  a  priori  density  function  p(xl ). 

5.  2  Reduced  Single -Target  Formula 

In  order  to  acquire  further  insight  into  Eq.  (5.  27)  and  develop  it  into  a  more  use¬ 
ful  form,  the  single -target  problem  will  be  considered  in  further  detail.  Thus  the  echo 
signal  is  of  the  form 

rix(t)  =  A  |(t  -r)  e^*^  ,  (5.28) 


=  E  +  E*  -  Re  X, 


x,  x' 


where 


E  = 

1 

2  - 

oo 

f 

Ux(t)|2dt  = 

-00 

E* 

2 

CO 

/ 

|rix,  (t)|2dt  = 

-00 

Xx, 

,  X* 

00 

L 

tix(t)  t|  x,  (t)dt  = 

function  of  dummy  variable  x* 

multiple -target  echo 
ambiguity  function  . 


« 


§£_ 

f 


J§ij| 
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where  the  transmitted  signal  is 

|{t)  =  R(t)  ej2,re(t)  e  j2it  V  ej2'7^ 


(5.  29) 


with 


R{t)  =  envelope  modulation,  having  an  assumed  maximum  value 
of  unity 

0 (t)  =  phase  modulation 
fQ  =  carrier  frequency. 


Then 


Re  v  ¥,  =  R«  f  AA‘  £*(t  -  t)  |(t  -t*  )  e  ^2ir  ^  dt 

X  "OO 


(5.  30) 


ao  j2ir[e(t-T» )- e(t-T)]  j2ir  (4>' -4>)t  j2irf  (t-t») 

=  R.e  f  AA'  R(t -r  )R{t-r' )e  e  e  dt  . 

-oo 


Letting 


and  then 


a  =  t  1  -  T 

P  =  4>'  -  4> 

t  -  T  =  t'  , 


dt  =  dt' 


it  is  found  that 
Re  *x,x«  =  Re 
We  may  write  Eq.  (5.  33)  as 

where 

and 


r  -jZn  (f  a-Pr)  oo  j2w[9(t«  -a)-0(t' )]  j2irPt» 

J  f  AA«  R(t')R(t'-a)e  e  dt' 

*  -oo 


(5.  31a) 
(5.  31b) 

(5.  32) 


.(5.33) 


Re  *x,x«  = 

l*A,A«(a 

00 

XA,A«(a'P) 

■  /  A*' 

-00 

e  =  arg  xAj 

A'  (Q* 

j2,r[e(iJ-a)-e(t' )]  j2n  pt« 


dt' 


(5.  34) 

(5.  35) 

(5.36) 


So  Eq.  (5.27)  becomes 
.(e) 


Ip  (*»^)  =  -  / 


In  f°°  e“TT  e  “^T  ^  A»  A»  <a*  P)  lcost2,r  (f0Q*^)'e] 

p(x' )  dx'  ,  (5. 37) 


-oo 
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-  in  Tjf- 


(5.45) 


We  may  interpret  this  equation  as  follows.  Before  the  measurement,  the  echo  energy 
was  expected  to  fall,  with  equal  likelihood,  between  zero  and  the  value  E*,,  and  the 
range  delay  and  Doppler  shift  were  expected  to  fall  uniformly  in  the  intervals | t  *» 
and  [*  A»  »  respectively.  Since,  in  fact,  the  echo  energy  was  zero,  we  cannot 

have  obtained  any  information  about  t  or  <j>  ,  However,  the  energy  value  of  zero  was. 
a  possible  a  priori  alternative  within  the  expected  energy  interval.  But  the  presence 
of  noise  prohibits  us  from  exactly  determining  that  the  energy  was  truly  zero.  In 
fact,  the  final  uncertainty  in  the  measurement  of  energy  is  the  uncertainty  of  the  noise 
energy  alone,  which  is  characterized  by  a  standard  deviation  of  cr^,  =  ,  Eq,  (5,45) 

thus  tells  us  that  the  measurement  has  permitted  us  to  divide  the  a  priori  region  of 
energy  uncertainty  £o,  E^J  into  N  =  -£-2.  intervals,  each  of  size  k  7  ,  and  to  declare 
(on  the  average)  that  the  energy  was  in  the  lowest  interval  EWO,  The  information  so 
obtained  is  that  given  by  Eq,  (5,45).  In  this  example,  further  support  is  also  advanced 
for  the  choice  of  6E  =  k#  as  a  quantization  level  for  energy. 

5.  3,  2  No  A  Priori  Uncertainty 

Here  we  assume  that  the  true  target  parameters  are  known  prior  to 
the  measurement.  That  is,  symbolically, 


p(x* )  =  6  (x‘  -  x) 


(5.46) 


Eq.  (5.  2?)  is  therefore 

oo  E*  +E  l  Re 

lie)(x,10  =  -  In  f  e  k?  e  *x’*'  6(x« -x)  dx«  .  (5.47) 

-00 

Since,  from  Eq.  (5.  26),  we  have 


=  2E 


(5. 48) 


then  Eq.  (5. 47)  evaluate  s  to 


,Ip  (*.Y)  =  -  In  1  =  0 


(5.49) 


as  would  be  expected. 

We  may  also  consider  a  case  regarding  partial  knowledge  of  the  parameters, 
a  priori.  Suppose  that,  in  the  single-target  case,  we  know  range  and  Doppler  but  not 
echo  energy.  Then 
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where 


p(x»)  =  8(t»  -r)  6(4>‘  -  <>)  P(E) 


p(E)  =  U  (Ea,  Eg) 


(5.  SO) 


(5.  51) 


Then  Eq.  (5.  38)  becomes 


I<e)(x,Y)  -  -  In  / 


En  E«+E 


p(E» )  dE*  .  (5.  52) 


Assume,  for  illustration,  that  the  signal  pulse  envelope  (of  duration  P)  is  rectangular 
so  that 


Then,  using 


-  A‘  CP 


P(A* )  -  p(E* ) 


(5.  53) 


(5.  54) 


Eq*  (5,  52)  becomes 


i;e)(A,Y)  *  -  in  / 

P  J  * 


A*  2  +A2 

~wm r 


=  -  4A(kj/P)  8  I0^IpjdA-.  (5.55) 

The  integral  is  now  recognized  as  the  integral  of  a  Rice  distribution  and  it  evaluates  to 
approximately  unity  if  the  interval  [a^,  Ag  J  includes  most  of  the  area  under  the  density 
function*  Thus,  we  have 


A«2+A2 


<A 


.V)  *  to  L 


eb~  ea 


(5.  56) 


which  should  be  compared  with  the  simpler  example  leading  to  Eq,  (5. 45).  It  is 
interesting  to  note  that 


VT  _  r.  _  A  Sr 

v  -  t?  -  Tkjr 

quantization  levels  in  the  energy  domain  suggests 

N1  -  J£r-  = 


(5.  57) 


(5.  58) 
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quantization  levels  in  the  rms -amplitude  domain.  This  implies  thai  rr>.i  amplitude  is 
"naturally*  quantized  into  increments  of 


’N-,JS2 


(5.59) 


which  is  the  rms  noise  at  the  output  of  a  filter  of  bandwidth  l/P  cps.  This  amount  of 
rms  noise  (determined  above  for  arbitrary  phase  modulation  and  rectangular  amplitude 
modulation)  is  equal  to  that  appearing  at  the  output  of  the  matched  filter  for  a  rectan¬ 
gular  CW  signal  pulse, 

5.  3,  3,  The  Case  of  High  Signal-to-Noise  Ratio 

We  shall  consider  the  case  of  large  values  of  A  and  A*  ,  and  shall  also 
restrict  the  analysis  to  a  small  neighborhood  of  the  (x,4>)  point  in  the  x*  -<j>*  plane 
which  is  at  the  peak  value  of  the  integrand  in  Eq,  (5.  38/.  (This  point  is  equivalent  to 
the  origin  in  the  a  -  p  plane, )  We  can  then  use  the  asymptotic  form  for  the  modified 
Bessel  function*  which  is 


IQ(z)  « 


Then  Eq.  (5.  38)  becomes 


z  »  1 


(5.  60) 


l/e)(x,y)=  -In  /  e 
P  J-co 

We  define 


Ixa>a«(q*P)I 


TT 


L  !xA,A'(a.P)| 
[2*  - 


X  (a»  P)  =  XAA*  ^ 

=  J  u(t*)  u(t-a)  e^2*^  dt 


p(x'  )dx*  .  (5.  61) 

(5.  62a) 
,  (5. 62b) 


where 


u(t)  =  R(t)e^ff®^  =  complex  transmitted  modulation  .  (5.63) 


Near  the  point  (a,  =  0,  P  =  0),  and  for  A'  a  A,  we  can  represent  X(a,  p)  by  a  truncated 
Maclaurin  series 

,  X  (a,  P)  =  X(0,  0)  +  (a  +  p  -^-)  X(0,  0)  +  -j-  (a  +  p  -Jp-  )  X(0,  0).  (5.  64) 

* 

Evaluation^’  ^  of  the  partial  derivatives  and  use  of  the  spectrum 

U(f)  =  Srfu(t)  ]  =  f°  u(t)  e  "j2,r£t  dt  ,  (5. 65) 
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leads  to  the  result: 


X(a,  p)  =  i§-  (1  7  a2  -  i-  "7  P2  +TF  ap) 

A 


where 


f2  £  J°  U!!t(f)  f2  U(f)  df 

•00 

t2"  ^  J°  u*(t)  t2  u(t)  dt 

•00 

■tr  £  (2TTjfA-2  f°°  u*(t)  tf  U(f)  e  j2trft  df  dt 
-oo  -oo 

=  zJjh.it  f°°  u*(t)  t  u«  (t)  dt 
2E  -oo 


(5.  66) 

(5.  67) 
(5.  68) 
(5.  69a) 
(5.  69b) 


In  a  peak-power-limited  radar  transmitter,  rectangular  amplitude  modulation  is  gener¬ 
ally  employed  to  obtain  maximum  transmitted  energy.  If  we  assume  this  situation,  then 
the  term  tF"  is  real-valued.  We  now  substitute  Eq.  (5.  66)  into  Eq.  (5.  61),  while  making 
the  assumption  that,  for  the  denominator  of  the  integrand  only,  we  can  allow  the  approx¬ 
imation 

XA,  A1  {G*  P)  =  **  X{a’  P)  *  -TT*  (5‘  70) 


within  the  neighborhood  of  (a  =  0,  P  =  0)  that  we  are  considering.  This  is  motivated  by 
the  observation  that  the  exponential  term  of  the  integrand  drops  rapidly  downward  (as 
a  function  of  a  and  P)  during  which  the  denominator  is  a  slowly  varying  function. 

Thus  Eq.  (5.  61)  becomes 


L^(x, y)«-ln  f  e 

P  -oo 


E*+E 

k?  . 


4irEA' 

e#t' 


ZEA'  „  1  1  T 

-2* 


P2+Tr 

p(x*  )dx'  . 

(5.  71) 


We  shall  concentrate  our  attention  on  the  range  and  Doppler  information  and  will, 
accordingly,  set  A  =  A’  while  understanding  hereafter  that  the  integration  is  only  over 
•t'  and  <j>' .  Eq.  (5.  71)  then  becomes 


-Inf 


00 


-^_(f2"a2+?rp2-  2"EF  aP) 


-cojZitp 


p(x»  )dx*. 


(5.  72) 


Letting 


P(x* )  =  Pfr1  )p(«t»f ) 


(5.  73) 


§ 
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where 


p(*M  =  U(ta,  tb)  ,  p(4>' )  =  U{*A. *B) 

Eq.  (5.  72)  may  be  written  as 


(5.74) 


l{>e)(x,'5f)  =  In 


(tb"ta,(+b-+a) 


l  -I(pFa2+p"tV-  2p~n  ap)  * 


(5.  75) 


f— 


dx' 


The  numerator  is  the  a  priori  surveillance  area  in  the  t  -  $  (or  a  -  P)  plane.  For  a 
fixed  p  ,  the  width  of  the  volume  determined  by  the  integration  in  the  denominator  may 
be  measured  in  terms  of  the  equation 


p  ?*  a2  -  2p  "tF  a|3  +  p"?  p2  =  1 


(5.  76) 


since  this  ellipse  describes  the  locus  of  points  at  which  the  integrand  is  e  -1/2 

times 

its  maximum  value.  The  area  of  this  ellipse  is57 


a  = 


fftT  °£ 


1  -  D 


where 


cr  s 


1 


ff4>  = 


4 


D  - 


-*T~ 
p  t4 

*ET 


(5.  77a) 

(5.  77b) 

(5.  78) 

(5.79) 

(5.  80) 


The  information  is  therefore  seen  to  be  related  to  the  logarithm  of  the  ratio  of  the  a 
priori  surveillance  area  to  an  equivalent  a  posteriori  area  given  by  Eq.  (5.  77b).  This 
result  is  comparable  to  an  expression  such  as  Eq.  (3.  51)  or  (3.  55a),  except  for  the 
additional  term  involving  D,  which  we  shall  call  the  interdependence  coefficient.  For 
given  values  of  cr  and  cr,  ,  maximum  information  is  obtained  when  D  =  0. 

T  9 
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& 

P: 

I 

I; 
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Since 

'IT  =  .:j.2lA  u*(t)  t  u'  (t)  dt 

2E  ™ 

-00 

then  the  Schwarz  inequality 

I  f{%)  g(t)  dt!2  <  / f*(t)  f(t)  dt  .  J g*(t)  g(t)  dt 


with 


£(t)  =  -J2£  U(t)  t 

fZE 

g(t)  =  -  j&s  u»  (t) 

4  2ir 


shows  that 


mi<pF 


Therefore,  we  have 


D  <  1 


In  terms  of  D,  the  ellipse  in  £q,  (5.  76)  is 


a*  2  «  ZD  a‘  |3‘  +  2  =  1 


where  a*  and  are  normalized  variables  given  by 

f 


In  matrix  form,  the  ellipse  in  fiq,  (5.  87)  is 

Tl  -D 

t*'"']  -D  1 


a1 

p* 


=  i 


(5.  81) 


(5.  82) 

(5.  83) 
(5.  84) 

(5.  85) 

(5.  86) 


(5.  87) 


(5.  88) 
(5.  89) 


(5.  90) 


The  eigenvalues  of  the  square  matrix  are  the  roots  of  the  characteristic  equation 


1  -  \ 

-D 


*  D 

1  -  \ 


=  l 


(5.  91) 


/  / 
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which  are 


Kl  =  1  +  D 


*2=1-0 


(5.  92a) 
(5.  92b) 


The  lengths  of  the  semi-major  and  semi-minor  axes  are  therefore 

and 


1 

Ih 


1 


(5.  93) 


If  D  =  0,  then  the  ellipse  becomes  a  circle  and  we  may  say  that  there  is  no  interdepend¬ 
ence  between  range  and  Doppler  information.  This  occurs,  for  example,  if  we  have 
rectangular  amplitude  modulation  and  no  phase  modulation,  since  then 


•y  A  2  P/2 

tr  =  -JJuA..,..  =  r  t  R(t)  r«  (t)  =  o 

2E  -P/2 


(5.  94) 


In  another  practical  case,  suppose  that  rectangular  amplitude  modulation  is  used  with 
linear  frequency  modulation  over  a  large  time -bandwidth  product  PB.  Then 


tT 


-i2tr  aP/2  2 

=  "  . .  f  A  e  t  (j2ir  e  9(t)  )dt 


j2tt  0{t)# 


2E 
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2E 
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Letting 
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9 

X 

1 

then 

tT  a  <2”>2 

rp/2  f2^t  _  tt2bp 

f 

2E 
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Also, 
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A2  t2  dt  =  *  P 
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* 

2E  J 
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and 

7  =  IM.2 

B/2  7  2  „2 

f  ^df  =  "  B 

1 

2E 
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(5.  96) 


(5.  97) 


(5.  98) 


(5.  99) 
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6.  APPLICATION  OF  RESULTS 


6. 1  Description  of  an  Existing  Advanced  FM  Radar  System 


In  this  chapter,  a  practical  radar  example  is  considered  to  illustrate  the  applica¬ 
tion  of  some  of  the  analytical  results  obtained  previously.  We  shall  deal  with  an  ad¬ 
vanced  type  of  radar  system  having  a  high  pulse -compression  ratio,  and  demonstrate 
quantitatively  how  its  performance  may  be  improved  by  means  of  the  derived  concepts. 
Such  a  radar  is  the  linear-FM  (chirp-type)  pulse  compression  system  described  in 
reference  58,  which  has  one  of  the  highest  pulse  compression  ratios  implemented  to 
date  in  an  operational  radar,  namely  8,000.  This  "range-channel*  system  achieves  a 


nominal  range  resolution  of  123  ft,  and  transmits  sufficient  energy  on  a  single  pulse  to 

_  1_.  -  :  _  1  r  ji  _  •  . _ -l  a. _ _ * _ _  _  _  _ .1  _ _ t*  r  A  ,  2  .  _  r 


obtain  a  15  db  signal-to-noise  ratio  on  a  radar  cross  section  of  0,1  m  at  a  range  of 
approximately  1000  nautical  miles.  Although  this  radar  represents  an  advanced  state- 
of-the-art  implementation,  it  will  be  shewn  that: 


(a)  By  using  the  proposed  nonlinear  processing,  the  range  resolution  can  be 
improved  by  a  factor  in  the  order  oijr,  where  p  is  defined  in  Eq.  (3.  29). 


(b)  The  detection-information  criterion  for  setting  the  detection  threshold 
leads  to  a  procedure  in  which  detection  probability  increases  with  time  for  a  constant 
overall  false-alarm  probability.  In  a  numerical  example,  it  is  shown  that  the  new 
procedure  is  substantially  more  efficient  than  a  conventional  Neyman-Pearson  amplitude 
procedure. 


The  radar  has  the  following  parameters: 


Peak  power 
Pulse  duration,  P 


2.  5  Mw 


2000  microseconds 


Pulse  repetition  frequency,  f 


Beam  width 


30  pps  (period,  rr  =  33  msec) 
2.  2  degrees 


Signal  bandwidth,  B 


4  Me  linear  frequency  deviation 


centered  at  f  =  427  Me 
o 


Range  window 


16. 4  nm 


The  system  concept  is  readily  explained  from  the  simple  block  diagram  in  Fig. 
6. 1.  The  EXCITEF.  generates  a  linear  FM  ramp  at  the  radar*  s  pulse  repetition  fre¬ 


quency.  This  transmitted  frequency  is  labeled  FR  in  Fig.  6.2.  The  echo  pulses  E 


arrive  at  a  range  delay  after  signal  transmission  and,  at  that  time,  a  range-track¬ 


ing  local-oscillator  FM  ramp  is  generated  by  the  EXCITER,  which  i»  called  the  delayed 


Only  one  target  echo  ramp  is  shown  in  Fig.  6. 2  for  illustration  but  there  is  actually 
one  for  each  target  present. 


EXCITER 


TRANSMITTED 

-  SIGNAL, - 

FR 

TRANSMITTER  .  . -  —  DUPLEXER 


LOCAL 
OSCILLATOR 
SIGNAL,  DCFR 


ECHO 
SIGNAL,  E 


HETERODYNER 
a  FILTER 


DIFFERENCE  - 
FREQUENCY 
SIGNAL 


SPECTRUM 

ANALYZER 


CRO 

DISPLAY 


Fig*  6.  i  Simplified  Block  Diagram  of  an  Advanced  FM  Radar 
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coherent  frequency  ramp  DCFR.  The  DCFR  is  heterodyned  with  the  echo  signal  and 
the  difference -frequency  signal  is  passed  through  a  real-time  spectrum  analyzer 
(Coherent  Memory  Filter)  and  displayed  on  an  oscilloscope.  If  the  DCFR  and  the  echo 
E  exactly  overlap  in  time  (At  =  0),  the  difference -frequency  signal  consists  of  a  con¬ 
stant-frequency  pulse  of  duration  P  with  a  frequency  of 


fd  =  *IF  "  fD 


where 


fjp  =  i-  f  offset  frequency 
fp  a  Doppler  shift  frequency. 

Since  the  pulse  width  is  equal  to  P,  the  spectrum  analysis  can  determine  f^  with  a 
resolution  in  the  order  of  p-  s  500  cps.  In  fact,  we  can  think  of  the  spectrum  analyzer 
as  a  bank  of  contiguous  filters,  each  having  a  bandwidth  of -p-  cps  which  is  matched  to 
the  duration  of  the  difference-frequency  pulse.  The  ratio  of  peaked  mean- square  sig¬ 
nal  to  mean- square  noise  at  the  spectrum  analyzer  output  is  calculated  from  the 
matched-filter  output  ratio  E/Nq  ,  where  E  is  input  signal  energy  and  Nq  is  noise 
power  spectral  density.  If  Srms  is  the  rms  value  of  the  difference-frequency  sinu¬ 
soidal  pulse,  then 

,2 

,  (6.1) 


E 


sz  P 

rms  y . 

. 


N 


rms 

r 


p-  T* 


which  shows  that  the  effective  noise  bandwidth  of  the  radar  is  l/P  cps. 

If  the  DCFR  does  not  exactly  overlap  the  echo  E  in  time,  then  the  difference  fre¬ 
quency  is 


fd  = 


*IF 


+  a  AT 


where 


For 


a  =  -p-  =  ramp  slope  =  2000  cps/microsecond. 


At  <  <  P 


(6.  2) 


(6.  3) 


(6.4) 


"X 


the  difference -frequency  pulse  has  a  duration  of  approximately  P.  So  the  spectrum 
analysis  skil  resolves  frequencies  in  the  order  of  l/P  cps  and  therefore  range-delay 
resolution^  obtained  such  that 


v 


Q  At  = 


1  1 

aF  =  T 


=  0,  25  microsecond 


Within  the  radar*  s  range  window  of  16.4  nm,  there  are  about  810  range  resolution 
cells,  which  also  represents  the  number  of  independent  opportunities  for  a  false  alarm 
for  each  radar  pulse,  A  characteristic  property  of  all  linear-FM  systems  is  that  there 
is  a  severe  interdependence  (or  ambiguity)  between  range  and  Doppler  information. 

This  interdependence  was  demonstrated  by  the  defined  interdependence  coefficient  D 
that  was  shown  to  have  the  maximum  value  of  unity  for  linear  FM.  The  interdepend¬ 
ence  is  clearly  seen  in  the  radar  under  consideration  since  both  range  and  Doppler 
effects  produce  changes  in  the  same  measured  variable  f^.  In  fact,  the  interdependence 
is  so  extreme  that,  for  a  number  of  closely- spaced  targets  flying  at  nearly  the  same 
velocities,  the  f^  frequency  axis  is  used  entirely  as  a  relative  range  axis.  (The  500  cps 
Doppler  resolution  corresponds  to  a  coarse  578  ft/sec  radial  velocity  resolution,  while 
the  0.  25  microsecond  range  resolution  corresponds  to  a  fine  range  resolution  of  123  ft. ) 


6.  2  Design  of  an  Optimum  Radar  System 


6.  2. 1  Resolution  Improvement 


A  linear  matched -filter  radar  followed  by  a  linear  envelope  detector 
produces  a  voltage  proportional  to  the  correlation  surface: 


|r(T,*)|  *  I f°  r(t)!*  (t  -T)  e  "^4*  I dt 


(6.7) 


where 

|(t)  -  the  transmitted  signal 

C, (t)  =  Aq  §(t  "  T0)  e  ^^o1  +  v(t)  =  noisy  received  echo. 

The  width  of  this  surface  was  seen  to  be  l/B  in  the  T  direction  and  l/P  in  the  4>  direction, 
where  B  and  P  are  the  signal  bandwidth  and  duration,  respectively. 

Since  the  a  posteriori  probability  density  function  p(r,<j>/£  )  was  found  to  be  pro¬ 
portional  to  I  (  t-h  |r(r,*)|),  range  and  Doppler  resolutions  in  the  order  of  the  width 
of  r'T.^/t,)  can  be  obtained  by  following  the  linear  detector  of  the  preceding  linear- 
matched-filter  implementation  by  a  nonlinear  element  having  the  characteristic  of  the 
modified  Bessel  function  I  (x).  This  would  then  yield  resolutions  of  — i —  and  — - — 

°  b/7  p/7 

for  t  and  <J>  respectively,  where 


?f  '"S'* 
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2E  _  2  X  echo  signal  energy 

**  “  Tcjf  ~  noise  power  spectral  de 


ensity 


(6.8) 


Ablock  diagram  of  such  a  system  is  presented  in  Fig.  6.  3  where  a  single  channel  is 
illustrated.  At  the  output  of  the  amplifier  G,  a  voltage  x(t)  occurs  having  a  value  of 
gjr  (t)|  where  g  is  adjustable  by  means  of  the  amplifier  gain,  G. 

We  wish  to  implement  a  final  detected  signal  SQ(t)  that  is  proportional  to 

n(t)  =  iQ  |r(t)|  )  .  (6.9) 

From  Eq.  (6.  7)  it  is  seen  that  the  maximum  value  of  |  T  (t)  |  is  the  i  latched  value 

|r(V  *0)|«  2E  (6.10) 

where  the  approximation  stems  from  the  conventional  neglect  of  the  noise  term  v(t), 
which  is  valid  for  high  signal-to-noise  ratios.  By  defining 


r*  (t)  * 


TET 


r(t) 


Eq.  (6.  9)  can  be  written  as 

pto*  i  (p | r* (t) | ) 


where 


r‘^max  ** 


,  (6.11) 

.  (6.12) 

.  (6.13) 


The  I0(x)  characteristic  Was  shown  in  Fig.  3, 7.  We  may  set  up  the  system  optimally 
for  a  specific  signal-to-noise  ratio  p  by  applying  such  a  calibration  signal  at  the  re¬ 
ceiver  input  and  adjusting  the  gain  G  so  that  the  peak  response  corresponds  to  x^=  p 
on  the  input  (abscissa)  axis  of  the  implemented  IQ(x)  characteristic.  When  this  adjust¬ 
ment  has  been  made,  the  noise  power  level  is  at  a  factor  of  p  below  the  peak  power 
of  the  signal  response  (or  p  /2  below  the  rms-squared  value  at  peak  response),  and 
therefore  the  noise  power  is  always  concentrated  below  the  knee  of  the  IQ(x)  curve. 

In  the  practical  case,  the  input  signal-to-noise  ratio  may  cover  a  range  of  possible 
values,  NoW  suppose  that  we  have  optimally  set  the  gain  G  for  a  particular  signal-to- 
noise  ratio  p0«  If  a  Signal  voltage  twice  as  large  as  expected  then  arrives,  |T(t)|  in¬ 
creases  by  a  factor  of  2,  as  indicated  by  an  increase  in  AQ  of  Eq.  (6.7).  For  the  same 
gain  G  previously  used,  the  excursion  of  x  in  Fig.  3.  7  increases  by  a  factor  of  2.  How¬ 
ever,  the  increase  in  input  voltage  by  a  factor  of  2  implies  an  increase  in  input  p  by 
a  factor  of  4  so  that,  optimally,  the  x-excursion  should  have  increased  by  a  factor  of 
4.  Thus  the  system  is  gain-matched  only  for  p  =  pQ  >  For  illustration,  suppose  that 


■*> 


the  input  signal-to-noise  ratio  may  vary  such  that 


4  <  p  <  25  (6  db  to  14  db)  .  (6. 14) 

As  a  compromise,  we  may  set  our  gain  G  so  that  it  is  optimum  for  an  input  signal  of 

2E 

Po  =  10db  =  10  =  ^  .  (6.15) 

If  the  signal  with  p  =  6db  should  occur,  it  is  a  factor  of  4  db  =  1.  58  less  in  voltage  and 
its  peak  response  will  only  reach  10/1.  58  =  6.  33  on  the  x-axis  instead  of  pQ  =  10.  On 

the  other  hand,  if  a  signal  with  p  =  14db  should  enter,  its  peak  response  will  reach 

1.  58  x  10  =  15.8  On  the  x-axis.  Fig.  6.4  shows  a  comparison  of  the  normalized  res¬ 
ponse  IQ(p|r  (t)|)/lQ(p)  obtained  in  the  above  situations,  where  it  is  always  assumed 
that  the  nonlinear  system  is  set  for  pQ  =  10;  i,  e. ,  we  are  implementing 

p(t)  =  I0  (po  I  r*  (t)  I )  ,  (6.16) 

where 

r‘(t)  =  -rtr  r(t)  ,  (6.17) 

o 

in  which  Eq  is  a  constant  while  T(t)  changes  proportionally  with  input  voltage.  Fig. 
6.4(a)  illustrates  a  typical  linear  response  and  Fig.  6.4(b)  shows  the  gain-matched 
nonlinear  response  for  p  *  pQ  =  10.  The  significance  of  the  improvement  is  best 
illustrated  by  observing  that  the  lateral  (range)  jitter  of  the  peak  in  Fig.  6. 4(a)  is 
characterized  by  a  standard  deviation  of  1/ 13  J  pQ  in  range  delay  or  a/ B  JpQ  =  1/R/fT^ 
in  frequency,  as  indicated  on  the  figure,  where  it  is  assumed  that  p  is  the  actual  input 
value  of  p.  Thus  the  jitter  (precision)  is  less  than  the  resolution  (granularity  or  accur¬ 
acy).  On  the  other  hand,  the  peak  width  (granularity)  in  Fig.  6. 4(b)  is  comparable  to 
the  lateral  jitter  (precision).  The  situation  is  analogous  to  observing  an  ammeter 
reading  in  which  the  thickness  of  the  needle  is  equivalent  to  our  resolution  width.  It 
is  most  desirable  to  have  the  needle  width  comparable  to  the  needle  jitter  (as  in 
Fig.  6.4(b))  rather  than  much  larger  (as  in  Fig.  6.4(a))  or  much  smaller.  Likewise, 
the  granularity  of  the  scale  on  which  we  are  reading  should  have  its  smallest  division 
comparable  to  the  jitter  width  (and  therefore  the  needle  width  also).  In  Fig.  6.4(c), 
the  response  is  given  for  am  input  p  of  6  db  while  the  receiver  is  set  for  pQ  *  10 db. 
Here  the  noise  becomes  more  prominent  since  the  gain  G  is  too  high.  Also,  the  width 
of  the  peak  would  be  narrower  than  is  theoretically  justified  so  that  the  lateral  jitter 
would  exceed  the  response  width.  Fig.  6.4(d)  shows  the  response  for  p  =  14 db,  which 
is  higher  than  the  set  pQ  =  10.  Here  the  peak  width  is  not  as  narrow  as  it  should  be 
and  some  resolution  is  sacrificed.  In  most  applications,  the  Be s sel-function  detector 


may  be  used  in  parallel  with  a  standard  linear  detector  and  then  employed  for  improved 
resolution  on  a  target  whose  signal-to-noise  ratio  can  be  judged  from  the  linear  dis¬ 
play,  Thus  the  gain  G  of  the  nonlinear  system  may  be  properly  adjusted  for  near¬ 
optimum  performance. 

O 

An  alternative  to  the  above  implementation  is  to  replace  the  linear  detector  in 
Fig.  6.  3  with  a  square -law  detector.  Then  we  are  implementing  an  output  signal  SQ(t) 
that  is  proportional  to 

<t)  =  I0  (P<f  |r*  (t)I2)  ,  (6.18) 

where 

I  r'  (t)  I  a  1 

1  '  ' 1  max 

and  the  gain  G  is  set  so  that  an  input  calibration  signal  with  signal-to-noise  parameter 

2 

PQ  will  give  a  maximum  excursion  of  x^  =  P0  •  Now,  however,  an  increase  in  input 
voltage  by  a  factor  of  2  will  change  the  x-excursion  by  a  factor  of  4  and  *her.e*ore,.the 
-'"Hew  maximum  value  x^  will  be  p  ,  as  it  should.  Therefore,  this  method  employing 
a  square-law  detector  always  remains  gain-matched,  although  we  have  altered  the 
response  shape  because  of  the  presence  of  |T  (t)  |  rather  than  |  F*  (t)  |  . 

6.2,2.  Improvement  in  Detection  Capability  by  Employment  of  the  Detection- 
Information  Procedure 

In  the  radar  under  consideration,  for  each  transmitted  pulse  there  are 
n  =  810  independent  opportunities  for  a  noise  threshold  crossing  and  one  opportunity 
for  a  threshold  crossing  due  to  signal  (with  a  single  target).  We  shall  assume  that  a 
threshold  test  is  made  for  each  such  transmitted  radar  pulse.  The  detection  probability 
Pn  may  be  calculated  from  curves  or  tables  of  the  Rice  distribution  for  any  assumed 
signal-to-noise  ratio.  *  *  The  false  alarm  probability  is  expressible  as 

sin 

PFA  =  1  “  <1“  PFA>  *  810  PFA  ’  for  810  PFA  <  <  1  *  l9> 

where 

PFA  =  probability  that  at  least  one  noise  sample  exceeds  the 
threshold  out  of  810  samples,  where  each  sample  has 
,  an  individual  probability  (Rayleigh-distributed)  PpA 

of  crossing  the  threshold. 

We  may  plot  I  vs.  threshold-to-rms  noise  level  R^/o^  for  various  values  of  signal-to- 
noise  ratio,  as  shown  in  Fig,  6»  5, 


As  an  example  of  the  application  of  the  above  results,  we  shall  assume  that  the 
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threshold  employed  is  4*5*  This  yields  maximum  information  for  S/N  ratios  from  at 
least  6  db  to  12  db,  although  the  amount  of  information  decreases  with  decreasing  S/N 
values.  The  false -alarm  probability  for  a  single  radar  pulse  is  then 


=  810  p; 


=  0. 0405 


(6.  20) 


from  the  Rayleigh  distribution.  We  now  accept  a  ^normal*  false  alarm  rate  based  on 
this  probability.  We  postulate  a  detection  procedure  in  which  a  single  output  pulse  is 
generated  if  there  are  one  or  more  threshold  crossings  per  radar  pul.'e.  If  there  is 
no  signal  present,  the  probability  c’  getting  such  an  output  pulse  is  =  0.  0405. 

This  may  be  considered  to  be  a  stochastic  process  in  which  the  probability  of  some  event 
occurring  is  pQ  =  0.  0405.  Then  the  probability  of  exactly  k  such  events  in  n  trials  is 


given  by  the  binomial  distribution 

*  /n\  ,  ~ , 


(6.21) 


which  is  approximately  equal  to  the  normal  distribution:  N(npQ,  npQ  (1  -  pQ)  )  ,  for3 
(l  *•  pD)  >3*  In  the  radar  under  consideration,  the  pulse  repetition  frequency  is 
f  ”  30  pps  SO  the  normality  approximation  will  hold  after  a  time  duration  of  about 


n  “  =  77  pulses 


(6. 22) 


7?  pulses 
30  pps 


=  2. 6  seconds 


nPoU-Po) 


(6.  23) 


The  density  function  for  output  pulse  rate  k/T  is  Nl  — —  ,  - m - /.  The  dura- 

n  XT  x  / 

tion  T  Will  be  taken  as  an  integral  number  of  pul^eprepetition  periods,  so  the  density 

function  may  be  expressed  as  being  N  (fy  pQ  ,  — — — ).  Here  it  is  seen  that 
the  mean  Value  of  rate  is  constant  and  the  variance  decreases  proportionally  with  time 
duration*  The  mean  value  Of  false-alarm  rate  can  be  determined  precisely  from  stand¬ 
by  observations  on  the  radar.  When  a  signal  appears,  the  data  rate  increases  and  es¬ 
sentially  becomes  equal  to  the  sum  of  (a)  the  false  alarm  rate  and  (b)  the  rate  with  signal 
present  but  no  false  alarms  included.  To  a  good  approximation,  this  new  rate  with 
signal  present  haS  the  distribution  of  the  sum  of  two  independent  normal  variables  and 

/  .  *rMl“Po>  frpl(l_pl>\ 

is  N  lfy  pQ  +  fr  Py  ^ -  +  - — - j  ,  where  p^  =  is  the  probability 


Even  when  the  normal  approximation  does  not  hold,  however,  the  mean  and 
variance  are  still  given  by  npQ  and  npQ(l  -  pQ),  respectively. 


/ 
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that  a  signal -plus-noise  sample  exceeds  the  threshold.  The  two  rate  density  functions 
(signal  absent  and  signal  present)  were  illustrated  in  Fig.  4.  2. 

^  We  may  apply  the  procedure  by  specifying  some  overall  false-alarm  probability, 
say  PFA  =  0.01,  after  T  seconds  of  observation  time.  In  the  absence  of  signal,  the 
density  function  for  rate  is  (approximate  foi  T  <  2. 6  seconds) 


N(frP»-  - 


Po  ^-Po5 


N  (1.  215,  ) 

T 


(6.  24) 


where 


•fr •  =  30  pulses  per  second 


pQ  -  0,  0405  =  probability  of  a  false  alarm  for  one  radar  pulse 
(810  noise  samples). 

The  amplitude  threshold  is  assumed  to  be  set  at  4.  5,  with  respect  to  rms  noise.  For 
an  overall  false  alarm  probability  of  PpA  =  0.  01,  the  data-rate  threshold  must  be  set 
at  2.  33  standard  deviations  above  the  mean  value.  This  data-rate  threshold  rT  is 
tabulated  in  Table  6. 1: 

TABLE  6.1  DATA-RATE  THRESHOLD  FOR  ?FA  =  0.  01 


rT  (output  pulses  per  second) 


3,730 
2.  880 
2.707 
2.474 
2.  340 
2.264 
2.185 
2.122 
2.  033 
2.  012 


As  an  example*  we  shall  assume  the  sudden  appearance  of  a  signal  with  an  rms  signal- 
to-noise  ratio  of  S/N  =  6  db.  With  the  chosen  amplitude  threshold  of  4.  5,  the  prob  - 
ability  of  a  single  sample  of  signal-plus-noise  crossing  the  amplitude  threshold  is 
Pi  fc  The  probability  density  function  for  rate  therefore  changes  to 


fr  Po  +  £r  Pi* 


£r  Po(l-P0>  ,  frPi(l-Px) 


=  N  (3.  315, 


(6^25) 
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Table  6.2  lists  the  difference  between  the  mean  value  and  the  threshold  rate  r^,  in 
standard-deviation  units,  and  also  the  corresponding  overall  detection  probability: 

Table  6.  2  DETECTION  PROBABILITY  FOR  DETECTION - 


T  (seconds) 


Mean  Value  Minus  r„ 
(standard  deviation  units) 

0.  349 
0.592 
0.  955 
1.235 
1.465 
1.695 
1.920 
2.190 
2.342 


For  comparison,  we  may  consider  the  Neyman-Pearson  approach  with  the  same 
radar.  Again  we  shall  assume  an  overall  false -alarm  probability  of  0.  01.  After  T 

A* 

seconds,  there  are  a  total  of  810  f^T  independent  noise  samples  which  can  cross  the 
amplitude  threshold.  The  overall  probability  of  a  false  alarm  is 


a  1  “  (1  “  P£a)81°  £*T  =  24,  300  T  P^A  =  0.  01 


(6.  26) 


where 


PFA  *  probability  that  a  single  noise  sample  exceeds  the  amplitude 
threshold. 


The  Single -sample  false-alarm  probabilities  are  tabulated  in  Table  6.  3  with  the  required 
thresholds: 


Table  6. 3 


LE  FALSE  ALARM  PROBABILITIES 


v  I  i  ■  fci SB  Wfl  ; 


PROCEDURE  (overall  PrA  =  0.01) 


Threshold,  R^,/ cfN 


2.06  x  10"' 
1,37  x  10"7 
1.03  x  10"7 
8.23  x  10"8 
6.  86  x  10"  8 
5.  88  x  10' 8 
5.  15  x  10" 8 
4.58  x  10'8 
4.  12  x  10“  8 


89  ; 

For  the  listed  thresholds,  the  single- sample  detection  probability  with  S/N  =  6db 
ranges  from  0.  005  to  0.  002  (using  the  Rice  distribution's  T  varies  from  2  seconds 
to  10  seconds.  The  overall  probability  of  detection  is  given  by 
-v  f  T 

PD  =  1  -  (1  -  )  r  (6.  27) 

and  is  tabulated  in  Table  6.  4: 

Table  6. 4  -  DETECTION  PROBABILITY  FOR  NE YMAN -PEARSON 


T  (seconds) 

frT 

JjD 

2 

0.0050 

60 

0,  26 

3 

0.  0042 

90 

0.  32 

4 

0.  0038 

120 

0.38 

5 

0. 0033 

150 

0.40 

6 

0. 0030 

180 

0. 44 

n 

i 

0.  0028 

210 

0. 45 

8 

0. 0025 

240 

0.46 

9 

0. 0022 

270 

0. 46 

10 

0, 0020 

300 

0. 46 

Comparative  results  for  the  two  procedures  are  plotted  in  Fig.  6.  6.  The  higher  detec¬ 
tion  efficiency  of  the  detection-information  procedure  is  attributed  to  its  initial  opti¬ 
mization  of  the  amplitude  threshold  independent  of  the  detection  and  false  alarm  prob¬ 
abilities,  In  the  Neyman-Pearson  amplitude  approach,  however,  the  amplitude  threshold 
determines  the  false  alarm  probability.  In  the  cited  example,  the  particular  overall 
false  alarm  probability  that  was  set  required  an  amplitude  threshold  that  was  rather 
high  and  relatively  inefficient  for  detecting  low-level  signals  such  as  the  signal  assumed 
at  S/N  =  6  db. 

In  addition  to  the  greater  efficiency  of  the  detection-information  approach,  there 
are  no  "false  alarms"  in  the  sense  understood  in  the  Neyman-Pearson  amplitude 
approach.  That  is(  in  the  Neyman-Pearson  amplitude  method  a  false  alarm  is  con¬ 
sidered  to  occur  whenever  noise  alone  crosses  the  amplitude  threshold.  However,  in 
the  detection-information  procedure,  a  certain  standby  threshold-crossing  rate  is 
accepted  as  normal.  An  alarm  occurs  only  when  the  rate  increases  " significantly"  , 

Just  how  much  of  a  rate  increase  is  considered  significant  depends  upon  the  confidence 
we  wish  to  achieve  in  avoiding  a  "false  alarm  type  of  mistake"  . 


7.  CONCLUSION 


7.1  General  Results 


By  employing  a  strict  information-theory  approach  to  radar,  it  has  been  possible 
to  develop  a  new  view  of  radar  signal  processing  leading  to  a  substantial  insight  into 
"ideal"  matched-filter  receivers.  This  generalized  viewpoint  has  yielded  a  number 
of  significant  results,  as  listed  in  Chapter  1,  which  include  a  method  of  improving  radar 
resolution  by  means  of  a  nonlinear  Bessel-function  envelope  detector  and  a  new  radar 
detection  philosophy  based  upon  a  defined  "detection  information*  and  a  data-rate 
threshold.  In  an  illustrative  example  dealing  with  an  existing  advanced  FM  radar,  the 
new  detection  procedure  was  shown  to  be  superior  to  a  conventional  Neyman  -Pearson 
procedure  applied  to  amplitude. 

Of  a  more  basic  nature,  theory  and  examples  have  been  presented  to  show  that 
the  information  obtained  by  a  radar  is  directly  related  to  the  input  physical  entropy  of 
the  receiver,  with  this  physical  entropy  being  synonymous  with  signal-to-noise  energy 
ratio  (SNER),  This  result  implies  that  the  parameter  information  has  the  character  of 
a  physical  entity  rather  than  only  an  arbitrary  measure.  Relations  were  also  developed 
which  clarify  the  role  of  the  SNER  in  improving  radar  detection  and  in  improving  the 
measurement  ••reliability*  of  the  radar. 

A  specific  formula  for  parameter  information  was  also  derived,  in  terms  of  a 
multiple -target  echo  ambiguity  function,  which  may  be  used  to  evaluate  the  variation 
of  the  information  with  changes  In  the  radar  waveform  or  the  target  environment. 
Analysis  of  the  formula  for  high  signal-to-noise  ratios  has  lead  to  the  definition  of  an 
explicit  interdependence  coefficient  between  range  and  Doppler  information. 

A  new  representation  and  treatment  of  time-limited  or  bandwidth-limited  white 
noise  was  developed  which  WaS  found  to  be  of  considerable  use  in  the  information-theory 
approach  to  radar  analysis.  This  representation  in  terms  of  modes  (or  degrees  of 
freedom)  should  also  be  found  useful  in  other  noise  problems. 

7.  2  Further  Work 

Considerable  further  work  may  be  done  along  the  lines  pursued  in  this  dissertation. 
Additional  theory  and  examples  to  substantiate  the  physical  nature  of  parameter  infor¬ 
mation  would  be  desirable,  and  possibly  an  experimental  "transducer"  to  convert  such 
information  into  useful  work, 

A  major  problem  area  in  current  radar  design  deals  with  waveform  analysis  and 
synthesis.  It  is  suggested  that  a  useful  tool  in  such  problems  would  be  the  evaluation 
of  the  expected  parameter  information  for  specific  assumed  target  distributions.'--. 
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This  would  appear  to  be  a  valuable  adjunct  to  the  present  practice  of  studying  the  am¬ 
biguity  function  of  the  waveform.  In  particular,  it  yields  a  single  number  as  a  per¬ 
formance  measure  in  a  target  situation  that  may  be  quite  complex. 

It  was  shown,  for  the  linear  receiver,  that  the  parameter  information  does  not 
exceed  the  input  entropy.  In  the  case  of  the  nonlinear  receiver,  this  condition  was 
postulated  (Eq.  3,  66).  A  proof  or  demonstration  of  this  would  be  desirable  for  the 
nonlinear  case. 

The  existence  of  a  positional  type  of  information,  and  its  relation  to  the  form  of 
Shannon' s  information,  as  in  Eq,  (3. 116),  opens  the  door  to  a  more  general  theory  of 
communication  in  which  both  positional  and  amplitude  information  are  communicated 
over  a  channel.  It  would  be  Worthwhile  to  explore  this  broader  view  of  a  communica¬ 
tion  link. 

The  improvement  in  resolution  by  means  of  a  Bessel-function  envelope  detector, 
and  the  new  radar  detection  procedure  based  upon  detection  information,  both  appear  to 
be  Valuable  contributions  to  current  radar  practice  and  should  lead  to  effective,  yet 
simple,  means  of  improving  radar  performance.  It  is  recommended  that  these  tech¬ 
niques  be  implemented  and  their  operational  performance  compared  to  that  of  conven¬ 
tional  practice. 


I 


BIBLIOGRAPHY 

L.  N.  Ridenour,  Radar  System  Engineering,  M.  I.  T,  Radiation  Laboratory- 
Series,  Vol,  1,  kicGraw-Hill  Book  Co. ,  IncT,  New  York,  N.  Y. ,  1947,  pp  33-35. 

D.  O.  North,  "An  Analysis  of  the  Factors  Which  Determine  Signal/Noise 
Discrimination  in  Pulsed-Carrier  Systems*  .  RCA  Tech.  Rept.  PTR-6C; 

June  25,  1943. 

W.  W.  Peterson,  T.G,  Birdsall,  W.  C.  Fox,  "The  Theory  of  Signal  Detectability"  , 
IRE  Trans.  PGIT-4;  September  1954, 

D.  Middleton,  "Statistical  Criteria  for  the  Detection  of  Pulsed  Carriers  in 
Noise"  ,  Parts  1  and  II,  J«  Appl.  Phys. ,  Vol.  24;  April  1953. 

M.  Schwartz,  "A  Coincidence  Procedure  for  Signal  Detection"  ,  IRE  Trans. 
PGIT-2;  December  1956. 

© 

J.  I.  Marcum,  "A  Statistical  Theory  of  Target  Detection  by  Pulsed  Radar"  , 

IRE  Trans.  PGIT-6;  April  I960.  Originally  published  as  RAND  Research 
Memo.  RM-754,  December  1,  1947  and  RM-753,  July  1,  1948. 

J.  L.  Lawson,  G.  E.  Uhlenbeck,  Threshold  Signals,  M.  I.  T.  Radiation  Laboratory 
Series,  Vol.  24,  McGraw-Hill  Book  Co. ,  Inc7,  New  York,  N.  Y.  1950. 

Section  7.  5,  pp.  167-173, 

D.  Middleton,  "Statistical  Theory  of  Signal  Detection"  ,  IRE  Trans.,  PGIT-3; 
March  1954. 

D.  Van  Meter,  D.  Middleton,  "Modern  Statistical  Approaches  to  Reception  in 
Communication  Theory"  ,  IRE  Trans.  PGIT-4;  September  1954. 

D.  Middleton,  D.  Van  Meter,  "Detection  and  Extraction  of  Signals  in  Noise 
from  the  Viewpoint  of  Statistical  Decision  Theory*  ,  J.  Soc.  Ind.  Appl.  Math. , 
Vol.  3,  December  1955  and  Vol,  4,  June  1956, 

J.  J.  Bussgang,  D.  Middleton,  "Optimum  Sequential  Detection  of  Signals  in 
Noise"  ,  IRE  Trans.  PGIT-U.Ue^eIaber  19S§._  . . . . 

H.  Blasbalg,  "The  Relationship  of  Sequential  Filter  Theory  to  Information 
Theory  and  Its  Application  to  the  Detection  of  Signals  in  Noise  by  Bernoulli 
Trials"  ,  IRE  Trans.  PGIT-3;  June  1957. 

H.  Blasbalg,  "The  Sequential  Detection  of  a  Sine-Wave  Carrier  of  Arbitrary 
Duty  Ratio  in  Gaussian  Noise*  ,  IRE  Trams.  PGIT-3;  December  1957. 

G.  W.  Preston,  "The  Search  Efficii  ncy  of  a  Probability  Ratio  Sequential  Search 
Radar"  ,  IRE  Internat,  Conv.  Record,  Vol.  8,  Part  4;  1960. 

A.  Wald,  Sequential  Analysis,  John  Wiley  and  Sons,  Inc. ;  New  York,  1947. 


P.  M  Woodward  and  I,  L.  Davies,  "Information  Theory  and  Inverse  Probability 
in  Telecommunication"  ,  Proc,  I,  E.  E. ,  Vol.  99,  Part  III;  March  1952, 

I. L.  Davies,  "On  Determining  the  Presence  of  Signals  in  Noise"  ,  Proc.,  I. E. E. , 
Vol.  99,  Part  IH;  March  1952. 


94 


17.  P.  M,  Woodward,  Probability  and  Information  Theory  with  Applications  to 

Radar,  McGraw-Hill  Book  Co. ,  Inc. ;  Hew  York;  1953.  *"*" 

18.  G.  L.  Turin,  "A  Review  of  Correlation,  Matched-Filter,  and  Signal-Coding 
Techniques,  with  Emphasis  on  Radar  Applications*  ,  Vol,  1,  Tech.  Memo  559, 

Hughes  Aircraft  Co, ,  Culver  City,  Calif, ;  April  1957. 

19.  W.  H.  Huggins  and  D.  Middleton,  "A  Comparison  of  the  Phase  and  Amplitude 
Principles  in  Signal  Detection*  Prcc.  National  Electronics  Conf. ,  Chicago, 

Vol.  11;  1955. 

20.  J.  Capon,  *A  Nonparametric  Technique  for  the  Detection  of  a  Constant  Signal 
in  Additive  Noise*  ,  WESCON  Conv.  Record,  Part  4;  1959. 

21.  R.  Manas se,  "Summary  of  Maximum  Theoretical  Accuracy  of  Radar 
Measurements"  ,  The  Mitre  Corp. ;  April  I960. 

22.  H.  Nyquist,  "Certain  Factors  Affecting  Telegraph  Speed"  ,  Bell  System  Tech¬ 
nical  Journal;  April  1924. 

23.  R.  V.  L.  Hartley,  "Transmission  of  Information"  ,  Bell  System  Technical  | 

Journal;  July  1928. 

24.  C.  E.  Shannon  and  W.  Weaver,  The  Mathematic  Theory  of  Communication, 

The  University  of  Illinois  Press,  Urbana,  ill;  1962. 

25.  L.  Brillouin,  Science  and  Information  Theory,  Academic  Press,  Inc. ,  New 
York;  1962. 

26.  W.  B.  Davenport,  Jr.  and  W.  L.  Root,  An  Introduction  to  the  Theory  of  Random 
Signals  and  Noise,  McGraw-Hill  Book  Co.,  Inc.,  New  York;  1958. 

27.  M.  Schwartz,  Information  Transmission,  Modulation,  and  Noise,  McGraw-Hill 
Book  Co. ,  Inc. ,  New  York;  1959. 

28.  P.  Bello,  " Time -Frequency  Duality"  ,  IEEE  Trans,  PGIT-10;  January  1964. 

29.  D.  Gabor,  "Theory  of  Communication"  ,  Journ.  I. E. E.  ;  November  1946. 

30.  J.  Capon,  "On  the  Properties  of  a  Time -Variable  Network;  The  Coherent 
Memory  Filter"  ,  Symposium  on  Active  Networks  and  Feedback  Systems, 

Polytechnic  Institute  of  Brooklyn;  April  I960. 

31.  D.  A.  Bell,  Electrical  Noise,  D.  Van  No  strand  Co. ,  Ltd.,  London;  I960. 

32.  A.  van  der  Ziel,  Noise,  Prentice -Hall,  Inc.,  Englewood  Cliffs,  N.  J. ;  1956. 

33.  H.  Nyquist,  "Thermal  Agitation  of  Electric  Charge  in  Conductors"  ,  Physical 
Review,  Vol,  32;  July  1928, 

34.  S.  O.  Rice,  "Mathematical  Analysis  of  Random  Noise*  ,  Bell  System  Technical 
Journal;  January,  1945. 

35.  D.  Middleton,  An  Introduction  to  Statistical  Communication  Theory,  McGraw-Hill 
Book  Co. ,  Inc. ,  New  York;  1960. 

36.  M.  L  Skolnik,  Introduction  to  Radar  Systems,  McGraw-Hill  Book  Co. ,  Inc, ; 

1962. 


37.  A,  I.  Mintzer,  "Advanced  Radar  Signal  and  Data  Proc sssing"  ,  Space/ Aero¬ 
nautics;  Nov,  1962  and  Jan. ,  April,  May,  1963. 

38.  H.  Bickel,  "Spectrum  Analysis  with  Delay  Line  Filters"  ,  IRE  WESCON 
Convention  Record,  Part  8;  1959. 

39.  J.  R.  Klauder,  A.  C.  Price,  S,  Darlington,  W.  J.  Albersheim,  "The  Theory 
and  Design  of  Chirp  Radars"  ,  Bell  System  Technical  Journal,  Vo.  39; 

July,  i960. 

40.  C.  E.  Cook,  "Pulse  Compression:  Key  to  More  Efficient  Radar  Transmission*  , 
Proc.  IRE,  Vol,  48;  March  1960. 


41,  C.  L.  Temes,  "An  Automatic  Tracking  System  for  Coherently  Processing  a 
Wide -Band  Long-Duration  Pulse  Sequence"  ,  Seventh  Annual  Radar  Symposium, 
Un.  of  Michigan,  Ann  Arbor,  Mich. ;  1961. 

42.  C.  L»  Temes,  "Relativistic  Consideration  of  Doppler  Shift"  ,  IRE  Trans. 
POANE-6;  March  1959* 


43.  K.  S»  Miller,  Engineering  Mathematics,  Rinehart  and  Co. ,  Inc. ,  New  York; 
1956, 


44.  C,  L«  Temes,  "Implementation  of  the  Ideal  Radar  Receiver  Us4ng  the  Coherent 
Memory  Filter*  ,  IRE  Seventh  Annual  East  Coast  Conference  on  Aero,  and 
Navig,  Electronics,  Baltimore,  Md. ;  1960. 

45.  C»  L.  Temes,  "Sidelobe  Suppression  in  a  Range-Channel  Pulse-Compression 
Radar*  ,  IRE  Trans.  PGMIL-6,  No.  2;  April  1962. 

46.  V.M,  Faires,  Applied  Thermodynamics,  The  MacMillan  Co. ,  New  York. 

N.Y.;t949.  ““ - - - 1 - 

47.  M.  W.  2,  email  sky,  Heat  and  Thermodynamics,  McGraw-Hill  Book  Co. ,  Inc. , 

New  York;  1957,  “*  "  ~ 

48*  R*H*  Fowler,  Statistical  Mechanics,  The  University  Press,  Cambridge, 
England}  1936.  — 

.49, .  G,.  Jqob,  e Theoretical  Physics,  Hafner  Publishing  Co. ,  New  York,  N.  Y. ; 

1930*  4  ,  4  *  «  . 

50,  H.  Margenau,  G,  M,  Murphy,  The  Mathematics  of  Physics  and  Chemistry, 

D*  Van  Nostrand  Co. ,  Inc, ,  New  York,  N.  Y. ;  1956. 

51,  A,  J.  Dekker,  Solid  State  Physics,  Prentice -Hall,  Inc. ,  Englewood  Cliffs, 

N»  J. , }  1958,  -  - 

52,  R.M.  Fano,  Transmission  of  Information,  The  M.  I,  T.  Press  and  John  Wiley 
and  Sons,  tnc,  ,  New  York,  N„Y. ;  1961. 

53,  J.  P,  Den  Hartog,  Mechanical  Vibrations,  McGraw-Hill  Book  Co. ,  Inc. , 

New  York,  N*Y*»  3rd  ed» ,  1942, 

54*  C.  L*  Temes,  "An  Automatic  Frequency-Control  System  for  a  High-Frequency 
Resonant-Type  Fatigue  Testing  Machine"  ,  Proc.  of  Soc.  for  Exper.  Stress 
Analysis;  1956* 


-j* 


i 


96 


55.  C.  L.  Temes,  "Analysis  of  a  Servomechanism  for  Fatigue -Testing  Metal 
Blades",  M.  S.  Thesis,  Case  Institute  of  Technology,  Cleveland,  Ohio;  1954. 

56.  E.  Parzen,  Modern  Probability  Theory  and  Its  Applicaticns,  John  Wiley  and 

Sons,  Inc. ,  New  York,  N.  Y.  ;iy60.  *"*" 

57.  C.  W.  HeUtrom,  Statistical  Theory  of  Signal  Detection,  The  MacMillan  Co. , 
New  York,  N.Y.  ;  i960. 

58.  C.  L.  Temes,  A.  Citrin,  M.  A.  Laviola,  H.  K,  Boyce,  J.  P.  Biggs, 
"Pulse-Compression  Subsystem  for  a  Down-Range  Tracker"  ,  IEEE  Inter¬ 
national  Convention,  Part  8,  New  York,  N.Y. ;  1963. 


* 


< 


Appendix  B.  Entropy  Increase  Due  to  Mixing 
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If  all  of  the  energy  E  were  added  uniformly,  the  system  temperature  would  rise 
from  to-?o  +  A#  .  The  temperature  Vq  +  A?  is  also  the  temperature  to  which 
the  system  would  settle  after  the  energy  E,  once  added  to  subvolume  V(xQ),  subse¬ 
quently  diffused  adiabatically  throughout  the  entire  volume.  During  such  a-diffusion 
process,  the  increase  in  system  entropy  is 


so  that 


6S  =  Cyw  (1  -  -L)  / 


q  4  v  q 

■ " o 


^o  +  qA? 


=  Cvw  In  (1 
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a  AS  -  AS* 


(B-2) 


(B-3) 


UNCLASSIFIED  BASIC  DISTRIBUTION  LIST 


Contract  No.  Nonr  839(38) 


Defense  Documentation  Center  .  20  copies 

Cameron  Station 

Building  5,  5010  Duke  Street 

Alexandria,  Virginia  22314 

Chief  of  Naval  Research  2  copies 

Department  of  the  Navy 
Washington,  D.  C..  20360 
Attn:  Code  427 

Commanding  Officer  1  copy 

Office  of  Naval  Research  Branch  Office 
Box  39,  Navy  #100  FPO 
New  York,  New  York 

Commanding  Officer  1  copy 

Office  of  Naval  Research  Branch  Office 
207  West  24th  Street 
New  York,  New  York 

Director  6  copies 

U.S.  Naval  Research  Laboratory 
Washington,  D.  C.  20390 
Attn:  Technical  Information  Office 
Code  2027 


_ Unclassified _ 

Security  Classification  _ 

DOCUMENT  CONTROL  DATA  •  R&D 

(Stajrity  cteMlWcaWaw  el  Hilt,  body  ol  «A ilwcl  «nd  Indming  mumttUon  wu«l  W  Wwrt  »Am  Sw  «p»m»  nfort  to  c toljW) 
1*  ORIGINATING  ACTIVITY  (Corporate  author)  jj*.  REPORT  SECURITY  C  LASSIFICATIi 


Polytechnic  Institute  of  Brooklyn 
Microwave  Research  Institute 


2«.  REPORT  tCCURI TV  CLARIFICATION 

_ Unclassified _ 

26.  4ROUP 


3.  REPORT  TITLE 


An  Analysis  of  Radar  in  Terms  of  Information  Theory  and  Ph;  .  lc  1  Entropy 

4  DESCRIPTIVE  NOTES  (Typt  of  f*por1  and  Inckittn  dettt) 

Research  Report  .Tune  1965 

5.  AUTHORfS;  (Lt»t  name.  Hnl  nan*.  Initial) 

Temes,  Clifford  L.  ,  Schilling,  Donald  L. 


«.  REPORT  DATE 

June  1965 

•  «.  CONTRACT  OR  ORANT  NO. 

Nonr-839(38) 

b.  PROJECT  NO. 


7«.  TOTAL  NO.  or  PAEEE  76.  NO.  OP  REPS 

_ 109  58 

ta.  ORIEINATOR'a  REPORT  NUMESRfSj 

PIBMRI-1270-65 


•  6.  ^TME R  Ry PORT  no (3)  (Any  otfiar  nutmJbmn  «ia(  «r  b* 


10.  AVAILABILITY/LIMITATION  NOTICES 

DDC 

11.  SUPPLEMENTARY  NOTES 

12.  6POKSORINO  MILITARY  ACTIVITY’ 

None 

Office  of  Naval  Research 

Washington  25,  D.  C, 

13.  ABSTRACT 


A  radar  is  basically  a  measuring  instrument  for  extracting  information  from  a 
received  signal  voltage.  Using  the  quantitative  concepts  of  "measurable  informa¬ 
tion"  ,  formulae  are  derived  which  relate  the  range  and  doppler  information  obtainet 
by  a  radar  to  the  amount  of  energy  required  to  obtain  it.  It  is  shown  that  the  re¬ 
ceived  information  is  bounded  such  that  it  is  always  less  than  the  input  physical 
entropy  E/£  ,  where  E  is  the  input  signal  energy  and  ?  is  the  equivalent  noise  tem¬ 
perature  of  the  radar.  Except  for  a  change  of  units,  this  physical  entropy  is  seen 
to  be  synonymous  with  the  standard  radar  expression  "  signal-to -noise  energy 
ratio"  .  Improved  radar  resolution  is  obtained  by  means  of  a  Bessel-function  en¬ 
velope  detector  that  effectively  increases  the  amount  of  range  and  doppler  signal 

2E 

compression  by  a  factor  of  ,  where  k  is  Boltzmann*  s  constant.  A  new 

detection  procedure  is  developed  in  which  an  amplitude  threshold  is  first  set  so  as 
to  maximize  a,  defined  "detection  information"  .  Target  detection  is  thm  based 
upon  the  use  of  the  Neyman-Pearson  procedure  in  the  threshold- crossing  rate  do¬ 
main  rather  than  in  the  conventional  voltage  amplitude  domain. 


UU  1  JAN  84  14/0 


Unclassified _ 

Security  Classification 


Security  Classification 


KEY  W080S 


ROUC  WT  ROUE  *>T 


radar,  information  theory,  entropy,  resolution 
detection,  matched  filters,  parameter 
estimation 


INSTRUCTIONS 


1.  ORIGINATING  ACTIVITY:  Enter  the  name  and  address 
of  the  contractor,  subcontractor,  grantee,  Department  of  De¬ 
fense  activity  or  other  organization  ( corporate  author)  issuing 
the  report. 

2a.  REPOR  r  SECUHTY  CLASSIFICATION:  Enter  the  over¬ 
all  security  classification  of  the  report.  Indicate  whether 
"Restricted  Date"  is  included.  Marking  is  to  be  in  accord¬ 
ance  with  appropriate  security  regulations. 

26.  GROUP:  Automatic  downgrading  is  specified  in  DoD  Di¬ 
rective  S200. 10  and  Armed  Forces  Industrial  Manual.  JEnter  , 
the  group  number.  Also,  when  applicable,  show  that  optional 
markings  have  been  used  for  Group  3  and  Group  4  as  author¬ 
ized 

3.  REPORT  TITLE:  Enter  the  complete  report  title  in  all 
capital  letters.  Titles  in  all  cases  should  be  unclassified. 

It  a  meaningful  title  cannot  be  selected  without  classifica¬ 
tion,  show  title  classification  in  all  capitals  in  parenthesis 
immediately  following  the  title. 

1.  DESCRIPTIVE  NOTES:  If  appropriate,  enter  the  type  of 
report,  e.g..  interim,  progress;  summary,  annual,  or  final. 

Give  the  inclusive  dates  when  s  specific  reporting  period  is 
covered, 

5.  AUTIIOR(S):  Enter  the  nsmefs)  of  authorfs)  as  shown  on 
or  in  the  report,  Entei  last  name,  first  name,  middle  initial. 

If  military,  stiow  rank  and  branch  of  service.  The  name  of 
the  principal  «:ithor  is  an  absolute  minimum  requirement 

6.  REPORT  DATE:  Enter  the  date  of  the  report  as  dsy, 
month,  year,  or  month,  year.  If  more  than  one  date  appears 
on  the  report,  use  date  of  publication. 

7 a.  TOTAL  NUMBER  OF  PAGES:  The  total  page  count 
should  follow  normal  pagination  procedures,  i.e.,  enter  the 
number  of  pages  containing  information. 

76.  NUMBER  OF  REFERENCES:  Enter  the  total  n  ...her  of 
references  cited  in  the  report. 

8a.  CONTRACT  OR  GRANT  NUMBER:  If  appropriate,  enter 
the  applicable  number  of  the  contract  or  grant  under  which 
the  report  was  written. 

86,  8l,  8c  8d.  PROJECT  NUMBER:  Enter  the  appropriate 
military  department  identification,  such  os  project  number, 
subproject  number,  system  numbers,  tssk  number,  etc, 

9a.  ORIGINATOR’S  REPORT  NUMBER(S):  Enter  the  offi¬ 
cial  report  number  by  which  the  document  will  be  identified 
and  controlled  by  the  originating  activity.  This  number  must 
be  unique  to  this  report. 

y6.  OTHER  REPORT  NUMBER(S):  If  the  report  has  been 
assigned  any  other  report  numbers  (either  by  the  originator 
or  bv  the  sponsor),  also  enter  this  numberfs). 

10.  AVAILABILITY/LIMITATION  NOTICES:  Enter  any  lim¬ 
itations  on  further  dissemination  of  the  report,  other  than  those 


Imposed  by  security  classification,  using  standard  statements 
such  as: 

(1)  "Qualified  requesters  may  obtain  copies  of  this 
report  from  DDC." 

(2)  "Foreign  announcement  and  dissemination  of  this 
report  by  DDC  is  not  authorised.  ” 

(3)  “U.  S.  Government  agencies  may  obtain  copies  of 
this  report  directly  from  DDC.  Other  qualified  DDC 
users  shall  request  through 

»» 

(4)  “V.  S.  military  agencies  may  obtain  copies  of  this 
report  directly  from  DDC  Other  qualified  users 
shall  request  through 


(S)  "All  distribution  of  this  report  is  controlled.  Qual¬ 
ified  DDC  users  shall  request  through 


If  the  report  has  been  furnished  to  the  Office  of  Technical 
Services,  Department  of  Commerce,  for  sale  to  the  public,  indi¬ 
cate  this  fact  and  enter  the  price,  if  known. 

1L  SUPPLEMENTARY  NOTES:  Use  for  additional  explana¬ 
tory  notes. 

12.  SPONSORING  MILITARY  ACTIVITY:  Etter  the  name  of 
the  departmental  project  office  or  laboratory  sponsoring  (pay¬ 
ing  lor)  the  research  and  development  Include  address. 

13-  ABSTRACT:  Enter  an  abstract  giving  a  brief  and  factual 
summary  of  the  document  indicative  of  the  report,  even  though 
it  may  also  appear  elsewhere  in  the  body  of  the  technical  re¬ 
port.  If  additional  space  is  required,  a  continuation  sheet  shell’ 
be  attached. 

It  is  highly  desirable  that  the  abstract  of  claseified  reports 
be  unclassified.  Each  paragraph  of  the  abstract  shall  end  with 
an  indication  of  the  military  security  classification  of  the  in¬ 
formation  in  the  paragraph,  represented  as  (TS),  (S),  (C).  or  (V). 

There  is  no  limitation  on  the  length  of  the  abstract.  How¬ 
ever,  the  suggested  length  is  from  ISO  to  225  words. 

14-  KEY  WORDS:  Key  words  are  technically  meaningful  terms 
or  short  phrases  that  characterize  •  report  and  may  be  used  as 
index  entries  for  cataloging  the  report.  Key  words  must  be 
selected  so  that  no  security  classification  is  required.  Identi¬ 
fiers,  such  as  equipment  model  designation,  trade  name,  siiUtaiy 
project  code  name,  geographic  location,  may  be  used  as  key 
words  but  will  be  followed  by  an  indication  of  technical  con¬ 
text.  The  assignment  of  links,  roles,  end  weights  is  optiooal. 


DD  /.2K.  1473  (BACK) 


Unclassified 
Security  Classification 


4 


